-- Logs begin at Tue 2022-05-03 15:25:08 UTC, end at Tue 2022-05-03 16:55:50 UTC. -- May 03 16:07:11.993305 dv-cinder-840324-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 16:07:12.002264 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 16:07:12 2022] *** May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: nodename: dv-cinder-840324-1-iscsi May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: machine: x86_64 May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: clock source: unix May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: pcre jit disabled May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: detected number of CPU cores: 4 May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: current working directory: / May 03 16:07:12.004207 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: detected binary path: /usr/bin/uwsgi-core May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: your processes number limit is 47680 May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: your memory page size is 4096 bytes May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: detected max file descriptor number: 2048 May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: lock engine: pthread robust mutexes May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: thunder lock: enabled May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 16:07:12.004750 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 16:07:12.051514 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: Python main interpreter initialized at 0x557addb639c0 May 03 16:07:12.051514 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: python threads support enabled May 03 16:07:12.051514 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: your server socket listen backlog is limited to 100 connections May 03 16:07:12.051514 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: your mercy for graceful operations on workers is 90 seconds May 03 16:07:12.051881 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: mapped 403077 bytes (393 KB) for 2 cores May 03 16:07:12.051969 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: *** Operational MODE: preforking *** May 03 16:07:12.052223 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: *** uWSGI is running in multiple interpreter mode *** May 03 16:07:12.052223 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: spawned uWSGI master process (pid: 80018) May 03 16:07:12.052428 dv-cinder-840324-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 16:07:12.055700 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: spawned uWSGI worker 1 (pid: 80029, cores: 1) May 03 16:07:12.055700 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: spawned uWSGI worker 2 (pid: 80030, cores: 1) May 03 16:07:12.055700 dv-cinder-840324-1-iscsi devstack@keystone.service[80018]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 16:07:17.896282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 16:07:17.896282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: from cryptography.utils import int_from_bytes May 03 16:07:17.897335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 16:07:17.897335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: from cryptography.utils import int_from_bytes May 03 16:07:17.900927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 16:07:17.900927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: from cryptography.utils import int_from_bytes May 03 16:07:17.901388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 16:07:17.901388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: from cryptography.utils import int_from_bytes May 03 16:07:17.946741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 16:07:17.946932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 16:07:17.947124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] command line args: [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 16:07:17.947416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 16:07:17.947595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ================================================================================ {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 16:07:17.947847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] admin_token = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.948090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] config_dir = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.948275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.948458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] config_source = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.948639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] debug = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.948835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 16:07:17.950309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 16:07:17.950444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] command line args: [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 16:07:17.950561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 16:07:17.950691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_config_append = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ================================================================================ {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 16:07:17.950818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_dir = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.950937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] admin_token = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_file = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] config_dir = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951116 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] config_source = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] debug = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.951947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_config_append = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.952907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_dir = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_file = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953569 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.953975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] publish_errors = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.954977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.955998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] standard_threads = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.956893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] use_journal = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] use_json = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] use_stderr = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] use_syslog = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.957825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] publish_errors = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.958051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.958162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.958279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.958417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.958540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.958653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.958771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.958890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.959003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.959114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.959236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.959376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] standard_threads = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.959494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.959607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.959728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.959849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.959974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.960088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.960088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] use_journal = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.960302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.960415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] use_json = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.960532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.960656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] use_stderr = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.960769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.960880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] use_syslog = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.961036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 16:07:17.961303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.961998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.962931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.963895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.964917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965834 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.965945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.966979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.967972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.968933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.969938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.970932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.971971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.972901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.973955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974069 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.974956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.975889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.976951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.977984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.978906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.979964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.980887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981855 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.981985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.external = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.982988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.password = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] auth.token = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.983986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.984857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.985495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.985622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.985759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.985923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.external = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.986982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.987894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.password = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] auth.token = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.988997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.989925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990731 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.990958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.991961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.992891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.993937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994855 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.994967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.995917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.996967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.997986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.998916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:17.999979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.000092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.000213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.000328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.000441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.000554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.000743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.001387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.001512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.001626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.001739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.001851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.001964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.002989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.003937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.004973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.005993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.006910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.007960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.008987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.009936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010263 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.010823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.011977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.012889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.013924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014263 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.014951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] role.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] role.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.015901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.016990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.017968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.018978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.019917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] role.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] role.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.020947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.021760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.022933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.023901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.024930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.025936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.026965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.connection = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.027903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.028929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029508 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.029969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.030975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.031887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 16:07:18.032085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.032085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.032085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.032085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.032743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.connection = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.032917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.033088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.033314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.033560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.033800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.034040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.034278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.034517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.034764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.035003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.035279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.035511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.035759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.035994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.036239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.036469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.036709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.036946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 16:07:18.037117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 16:07:18.062115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.062345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.062572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.065162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.065393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.065618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.072195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.074468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.102250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.102473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.103530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.103768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.158222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.158953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.210929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.211153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.211298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.211412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.277615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.277842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.278992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.279214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.279454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.302808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.303950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.304034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.304165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.304247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.304419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.315558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.316331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.329913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.330149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.330369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.330591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.330675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.330811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.330894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.331968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 16:07:18.348941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.349147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 16:07:18.349481 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.349639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.349723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 16:07:18.349853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 16:07:18.349938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.350182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.350264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.350383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 16:07:18.350474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.350656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.350737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.350916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.351179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.351466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.362528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.362800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.363065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.363366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.363653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.363931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.364196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.364474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.371543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.372661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.374829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.375106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.375410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.375832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.376114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.376293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.376390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.376629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.376712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.376898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.376981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.377165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.377299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.377433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.377587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.377696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.377852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.378121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.378397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.378667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.378943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.379210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.404605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.406205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.406413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.406504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.408951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.409174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.412344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.412618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.412896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.414474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.414751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.415026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.420196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.420474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.422385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.423394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.432163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.432865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.432865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.433273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.433273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.446823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.447105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.449528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.449806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.451660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.454802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.455558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.455853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.458512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.458813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.460823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.463958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.464438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.467723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.468196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.468493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.468773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.469055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.469843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.470141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.472393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.472699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.472980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.473262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.473549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.473828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.489774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.490149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.490417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.490679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.494146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.494532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.494801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.495066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.498640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.502334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.502334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.503889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.504103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.504215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.504444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.504721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.504990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.505954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.506232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.509388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.509674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.509974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.510256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.510534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.519208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.519509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.519783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.520057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.520333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.520605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.520875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.527229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.527229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.527404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.527664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.527972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.528255 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.528531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.540070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.543349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.546678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.548404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.548988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.550026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.550302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.550589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.552672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.556124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.557735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.558083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.559419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.559701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.559784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.559994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.562914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.563333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.563705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.563990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.568007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.569619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.572939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.573227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.573310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.573510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.573593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.573785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.573868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.582352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.582626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.582903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.583186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.583482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.583749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.584025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.584110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.584307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.584413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.584575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.584665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.584841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.585115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.585377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.585646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.585920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.592628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 16:07:18.592911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.593200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.593480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.593749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.594024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.594298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.595296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.595705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.595996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.596271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.596543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.596810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.597087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 16:07:18.625088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557addb639c0 pid: 80030 (default app) May 03 16:07:18.628585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a63650-8ad9-4b5b-84fd-7ff8768566fb None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:18.628884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a63650-8ad9-4b5b-84fd-7ff8768566fb None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:18.629166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a63650-8ad9-4b5b-84fd-7ff8768566fb None None] PATH_INFO: `/v3` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:18.633329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue May 3 16:07:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:18.636846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557addb639c0 pid: 80029 (default app) May 03 16:07:27.966701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23bd1-59b8-473b-a821-18c2006cb259 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:27.967310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23bd1-59b8-473b-a821-18c2006cb259 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:27.967310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e23bd1-59b8-473b-a821-18c2006cb259 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:27.968627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:27.976998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:27.977400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:27.977557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:28.007838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG oslo_db.sqlalchemy.engines [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 16:07:28.194186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG passlib.handlers.bcrypt [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80029) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 16:07:28.194603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG passlib.handlers.bcrypt [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80029) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 16:07:28.249378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:28.251840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:28.376116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 03 16:07:28.514319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e23bd1-59b8-473b-a821-18c2006cb259 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:28.548890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG oslo_db.sqlalchemy.engines [None req-d3e23bd1-59b8-473b-a821-18c2006cb259 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 16:07:28.676434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e23bd1-59b8-473b-a821-18c2006cb259 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:28.680704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:28.681368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:28.681656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:28.681938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:28.689989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:28.742298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 16:07:28.742642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c4530-66e0-4bf9-a59e-c6000607fe6d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:28.752117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue May 3 16:07:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 16:07:28.758109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:28.773055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b338-108e-430c-89d0-14415b537f11 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:28.777524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:28.778661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:28.778946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:28.779222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] PATH_INFO: `/v3/projects/edec15e0ee20483fb7e945e977a36993` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:28.780763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] RBAC: Authorizing `identity:get_project(project_id=edec15e0ee20483fb7e945e977a36993)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:28.838213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 16:07:28.838550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32f40-683b-4f2c-aacf-70e10825c248 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:28.843196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 2/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue May 3 16:07:28 2022] GET /identity/v3/projects/edec15e0ee20483fb7e945e977a36993 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:31.037306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015e80-cbe1-48ac-888b-3f4c170f6025 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:31.037902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015e80-cbe1-48ac-888b-3f4c170f6025 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:31.037902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015e80-cbe1-48ac-888b-3f4c170f6025 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:31.041962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 4/6] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:31.047201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:31.047649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:31.047792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:31.067526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:31.069049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:31.076978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 03 16:07:31.099614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015e80-cbe1-48ac-888b-3f4c170f6025 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:31.111396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015e80-cbe1-48ac-888b-3f4c170f6025 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:31.115557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894edd9-4031-491d-af2a-fc2eee50c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:31.116180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894edd9-4031-491d-af2a-fc2eee50c702 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:31.116462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894edd9-4031-491d-af2a-fc2eee50c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:31.116781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894edd9-4031-491d-af2a-fc2eee50c702 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:31.124267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894edd9-4031-491d-af2a-fc2eee50c702 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:31.126056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894edd9-4031-491d-af2a-fc2eee50c702 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:31.134608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue May 3 16:07:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:07:31.139835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:31.149421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b726d-ab36-4a7e-af9a-0b37da6ef3bc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:31.153807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb7e0-c6a3-4259-9b69-10b32eec40b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:31.154659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb7e0-c6a3-4259-9b69-10b32eec40b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:31.154941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb7e0-c6a3-4259-9b69-10b32eec40b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:31.155214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb7e0-c6a3-4259-9b69-10b32eec40b0 admin admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:31.157333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb7e0-c6a3-4259-9b69-10b32eec40b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:31.159119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb7e0-c6a3-4259-9b69-10b32eec40b0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:31.160706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 4/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue May 3 16:07:31 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:33.447048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0ca6-a385-4de6-87df-73911b672eb8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.447609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0ca6-a385-4de6-87df-73911b672eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.447713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0ca6-a385-4de6-87df-73911b672eb8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.449159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:33.454046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.454467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.454598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.469191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f9f08-a36f-491b-92e3-cc99728949c1 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.469521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f9f08-a36f-491b-92e3-cc99728949c1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.469849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f9f08-a36f-491b-92e3-cc99728949c1 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.471239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 7/11] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:33.476918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.477221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.477486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.520147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG passlib.handlers.bcrypt [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80030) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 16:07:33.520567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG passlib.handlers.bcrypt [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80030) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 16:07:33.569019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:33.570641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:33.582196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:33.583398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:33.662205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:33.669347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:33.685779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:33.691365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:33.782264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259bea3-081f-4c1a-95bf-0109bbaf80fd None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:33.786619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625250b5-6889-43ff-a0d5-62dba70fec72 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:33.814745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:33.815579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.815867 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.816141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.818898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:33.820630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.821160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.821626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.827540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:33.838608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:33.839672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:33.840827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 6/14] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:33.846107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:33.891472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:33.893115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:33.945050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c519-4c55-480c-9f4d-bebfcf723a8d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:33.978582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:33.979239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:33.979549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:33.979828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:33.980574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:33.980878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:33.982260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:33.987480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 9/15] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:07:33.993052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:33.994045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 7/16] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:33.999238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:34.087121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a969a-9bd6-4e79-a8db-74c7ef46889d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:34.095965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296df2bb-864e-46a3-b3db-0a53e4dacf35 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:34.118611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:34.119425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:34.119741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:34.120015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:34.131548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:34.132442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:34.132728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:34.133012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:34.134294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:34.135908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:34.137599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:33 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:34.143577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:34.248846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb77aa-748b-4725-a7ab-3b1012217eed None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:34.249044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:34.250513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:07:34.272092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:34.272930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:34.273751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:07:34.273751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:07:34.273751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:07:34.273751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:34.273751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:07:34.279065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:34.284174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:34.284969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:34.285253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:34.285529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:34.286711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:34.288192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:34.289791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:34.295352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:34.377037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4ec8-ad15-45d4-ad15-27b59d057555 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:34.388386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157f7ed-4e62-4f17-a2a2-719e4ba12152 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:34.410492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:34.411157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:34.411482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:34.411779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:34.412504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:34.412814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:34.414215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35623e-65df-4d1d-a93f-b602fff0d586 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:34.421737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:34.422862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:34.423148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:34.423458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:34.424287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.domain.id=default, user.id=bb40ca9c41484170a3eb1edcceb6c0bf) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:34.424600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:34.426008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4be0-d869-43c6-b8ec-9e25d9e81882 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:34.431039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:34.432456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1322 bytes} [Tue May 3 16:07:34 2022] GET /identity/v3/role_assignments?user.id=bb40ca9c41484170a3eb1edcceb6c0bf&scope.domain.id=default&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:37.020609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cd3b-a268-4887-a6eb-ea80091cf075 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.021893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cd3b-a268-4887-a6eb-ea80091cf075 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.022388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cd3b-a268-4887-a6eb-ea80091cf075 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.024002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:37.039716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09d7a1-c9d0-4e59-8a83-493b1b019d40 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.040557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09d7a1-c9d0-4e59-8a83-493b1b019d40 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.041005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09d7a1-c9d0-4e59-8a83-493b1b019d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.065037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9b09d7a1-c9d0-4e59-8a83-493b1b019d40 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:37.066668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9b09d7a1-c9d0-4e59-8a83-493b1b019d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:37.154302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:37.184281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cd3b-a268-4887-a6eb-ea80091cf075 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:37.323955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cd3b-a268-4887-a6eb-ea80091cf075 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:37.334991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a1c0d-bf81-4c0f-a0d0-01d712f6ff8c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.334991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a1c0d-bf81-4c0f-a0d0-01d712f6ff8c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.334991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a1c0d-bf81-4c0f-a0d0-01d712f6ff8c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.334991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:37.338918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f57e-27d8-4dd5-9eb0-c4b9883ac387 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.339462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f57e-27d8-4dd5-9eb0-c4b9883ac387 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.339941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f57e-27d8-4dd5-9eb0-c4b9883ac387 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.342096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 13/25] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:37.344572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.345137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.345610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.366638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:37.368711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:37.392916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8e887-9602-4db1-bec7-df66db45e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:37.393726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8e887-9602-4db1-bec7-df66db45e7dd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.394056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8e887-9602-4db1-bec7-df66db45e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.394283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8e887-9602-4db1-bec7-df66db45e7dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.424159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8e887-9602-4db1-bec7-df66db45e7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-7da8e887-9602-4db1-bec7-df66db45e7dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:37.435835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:37.436678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:37.437528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:37.443630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 13/26] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:37.445056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.445342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.445619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.457662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:37.458590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:37.482432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:37.483673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:37.586621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea28dc-ea2c-4936-afd9-0d878aefd5f7 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:37.625662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:37.626333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.626616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.626895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.627684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:37.627989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:37.630662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:37.635305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:37.636249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:37.646760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 15/29] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:37.652016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:37.770820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57880e-f741-4937-83af-6ba390dc985b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:37.786295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688efed0-57b2-4d3b-9d43-171d0f7ef44d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:37.815988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:37.816888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.817167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.817439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.818703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:37.820346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:37.822541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 16/30] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:37 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:37.823589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:37.837184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:37.838357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:37.838841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:37.839357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:37.860742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:37.862583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:07:37.888628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:37.889508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:37.890349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:07:37.890349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:07:37.890349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:07:37.890349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:37.893292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 15/31] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:37.894329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:38.022142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d899b-8b72-4295-b201-ab9efdbadfed None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:38.035707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0cd41-652b-4aea-b0fa-3ccdec67cda2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:38.070105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5e4e1-d66e-44ef-9f52-96682aac7033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:38.070787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5e4e1-d66e-44ef-9f52-96682aac7033 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.071077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5e4e1-d66e-44ef-9f52-96682aac7033 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.075276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5e4e1-d66e-44ef-9f52-96682aac7033 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.075276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5e4e1-d66e-44ef-9f52-96682aac7033 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:38.075276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5e4e1-d66e-44ef-9f52-96682aac7033 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:38.084003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:38.084827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.085117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.085393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.086880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:38.097766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:38.097766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 16/32] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:38.097766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:38.221737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c7169-2fb6-4861-9604-dac1a22dbd29 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:38.275895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:38.276564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.276847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.277174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.278055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:38.278366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:38.279785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:38.292666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:38.293547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:38.313358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1131 bytes} [Tue May 3 16:07:37 2022] POST /identity/v3/roles => generated 219 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:38.314916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112227-b5bb-4e26-b731-18840a42230d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.315210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112227-b5bb-4e26-b731-18840a42230d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.322918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112227-b5bb-4e26-b731-18840a42230d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.324814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 18/35] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:38.325571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112227-b5bb-4e26-b731-18840a42230d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:38.433285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7d72-ffaf-4e51-be67-ab0150f953f7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:38.475894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63083f76-3c3a-481e-aceb-b663cb23838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:38.477055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083f76-3c3a-481e-aceb-b663cb23838f None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.477537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083f76-3c3a-481e-aceb-b663cb23838f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.477843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083f76-3c3a-481e-aceb-b663cb23838f None admin] PATH_INFO: `/v3/domains/default/users/bb40ca9c41484170a3eb1edcceb6c0bf/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.482007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083f76-3c3a-481e-aceb-b663cb23838f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bb40ca9c41484170a3eb1edcceb6c0bf, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:38.483998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083f76-3c3a-481e-aceb-b663cb23838f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:38.486018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112227-b5bb-4e26-b731-18840a42230d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:38.528107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cdde5-9fc1-48ac-aadb-e6acc4aaaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:38.529115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cdde5-9fc1-48ac-aadb-e6acc4aaaabb None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.529627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cdde5-9fc1-48ac-aadb-e6acc4aaaabb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.530106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cdde5-9fc1-48ac-aadb-e6acc4aaaabb None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.531653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cdde5-9fc1-48ac-aadb-e6acc4aaaabb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:38.533591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cdde5-9fc1-48ac-aadb-e6acc4aaaabb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:38.632420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 19/36] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:07:38 2022] POST /identity/v3/projects => generated 301 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:38.634176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf149dce-af01-4cac-b67d-d4c5619e63b7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.634691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf149dce-af01-4cac-b67d-d4c5619e63b7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.635149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf149dce-af01-4cac-b67d-d4c5619e63b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.654367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bf149dce-af01-4cac-b67d-d4c5619e63b7 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:38.657517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bf149dce-af01-4cac-b67d-d4c5619e63b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:38.700268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 18/37] 10.222.0.42 () {58 vars in 1361 bytes} [Tue May 3 16:07:38 2022] PUT /identity/v3/domains/default/users/bb40ca9c41484170a3eb1edcceb6c0bf/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:07:38.702174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ab89b-17b5-4e37-82c1-3e31e8f7bb08 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.702508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ab89b-17b5-4e37-82c1-3e31e8f7bb08 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.703347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ab89b-17b5-4e37-82c1-3e31e8f7bb08 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.708167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 19/38] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:38.709368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fadb1-8ab8-4666-abb1-d49fd6c62eb6 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.709669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fadb1-8ab8-4666-abb1-d49fd6c62eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.709960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fadb1-8ab8-4666-abb1-d49fd6c62eb6 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.711394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 20/39] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:38.717086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.717389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.717665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.739900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:38.741620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:38.744540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:38.746252 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:38.746697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:38.747147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:38.770141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:38.771970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:38.848905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:38.855425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:38.877158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:38.881757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:38.981742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686faa7-7950-485d-8ae3-c90b6b2dd601 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:39.004693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc137c3-c042-4287-bff4-e11de3bdf8a9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:39.015038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:39.015927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:39.016374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:39.016680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:39.017817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:39.019462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:39.038286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:39.051296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:39.051296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:39.051296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:39.051296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:39.051296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:39.121789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 22/43] 10.222.0.42 () {60 vars in 1131 bytes} [Tue May 3 16:07:38 2022] POST /identity/v3/roles => generated 225 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:39.122628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:39.150842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1131 bytes} [Tue May 3 16:07:38 2022] POST /identity/v3/roles => generated 223 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:07:39.251522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e736949-f48f-4fd8-ba98-c462f3950c01 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:39.293352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5548d91-6544-419f-9fa5-a536dd621e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:39.294195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5548d91-6544-419f-9fa5-a536dd621e25 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:39.294486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5548d91-6544-419f-9fa5-a536dd621e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:39.294773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5548d91-6544-419f-9fa5-a536dd621e25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:39.296135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5548d91-6544-419f-9fa5-a536dd621e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:39.297875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5548d91-6544-419f-9fa5-a536dd621e25 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:39.299735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 23/45] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:39.305979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:39.417905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33326c9-20e8-40ed-946a-27a8528cacb9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:39.452051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933a95-20aa-42be-ba31-c77ad932303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:39.453248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933a95-20aa-42be-ba31-c77ad932303a None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:39.453536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933a95-20aa-42be-ba31-c77ad932303a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:39.453834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933a95-20aa-42be-ba31-c77ad932303a None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:39.454548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d933a95-20aa-42be-ba31-c77ad932303a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:39.456127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d933a95-20aa-42be-ba31-c77ad932303a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:39.568440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:07:39 2022] POST /identity/v3/projects => generated 312 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:41.082141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc9f6-b9cd-40e7-8b30-3a9962f80ed9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.082659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc9f6-b9cd-40e7-8b30-3a9962f80ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.082767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc9f6-b9cd-40e7-8b30-3a9962f80ed9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.084267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:41.089117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.089544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.089707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.106414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:41.107603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:41.171261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:41.194744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc9f6-b9cd-40e7-8b30-3a9962f80ed9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:41.296164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc9f6-b9cd-40e7-8b30-3a9962f80ed9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:41.329423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:41.330216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.330504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.330786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.340692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:41.348881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:41.349696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:41.350453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:07:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:41.355961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:41.452370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9859d-3ad2-4cc8-8c23-a4744929062b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:41.485580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:41.486244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.486562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.486838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.487626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:41.487937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:41.489316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:41.497251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:41.503808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:41.605159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3fdc-c2ae-47cd-8ffb-cdc0cb2a11e1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:41.641170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeb690-fb6d-4dbd-b660-764989b900de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:41.642054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb690-fb6d-4dbd-b660-764989b900de None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.642341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb690-fb6d-4dbd-b660-764989b900de None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.642622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb690-fb6d-4dbd-b660-764989b900de None admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.644136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeb690-fb6d-4dbd-b660-764989b900de None admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:41.645618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeb690-fb6d-4dbd-b660-764989b900de None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:41.647564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 26/51] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:41 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:41.653078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:41.747928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d46b-3b36-4f77-a62f-82dcaaf1ca3b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:41.779890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:41.781249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.781547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.781820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.782985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:41.784451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:41.786060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:41.791482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af8f1f-58cf-401b-8ae3-bc6ea8dad7ee None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.791612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:41.791783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af8f1f-58cf-401b-8ae3-bc6ea8dad7ee None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.792069 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af8f1f-58cf-401b-8ae3-bc6ea8dad7ee None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.793431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 27/53] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:41.798423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.798719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.799009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.815634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:41.816868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:41.882531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 28/54] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:41.884328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e6b90-e75d-40da-bf49-b71048827d31 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:41.906235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:41.916260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:41.916913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:41.917195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:41.917470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:41.918289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.domain.id=default, user.id=bb40ca9c41484170a3eb1edcceb6c0bf) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:41.918598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:41.920046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:41.926552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1322 bytes} [Tue May 3 16:07:41 2022] GET /identity/v3/role_assignments?user.id=bb40ca9c41484170a3eb1edcceb6c0bf&scope.domain.id=default&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:42.007434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975ae0-30b9-4135-a3f7-a21750808c18 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:42.042885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61cf68-9d93-47e0-bc0e-c229fd26cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:42.043733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61cf68-9d93-47e0-bc0e-c229fd26cb05 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:42.044026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61cf68-9d93-47e0-bc0e-c229fd26cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:42.044309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61cf68-9d93-47e0-bc0e-c229fd26cb05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:42.045531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61cf68-9d93-47e0-bc0e-c229fd26cb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:42.047938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61cf68-9d93-47e0-bc0e-c229fd26cb05 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:42.049647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 29/56] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:07:42.055558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:42.156788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2087b2-b0d8-42bf-bd9e-987db9d1d073 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:42.189050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b55b4d-e36d-4eda-b000-985dffa897f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:42.189716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b55b4d-e36d-4eda-b000-985dffa897f1 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:42.190004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b55b4d-e36d-4eda-b000-985dffa897f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:42.190284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b55b4d-e36d-4eda-b000-985dffa897f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:42.190987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b55b4d-e36d-4eda-b000-985dffa897f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:42.192457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b55b4d-e36d-4eda-b000-985dffa897f1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:42.283174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 28/57] 10.222.0.42 () {60 vars in 1140 bytes} [Tue May 3 16:07:42 2022] POST /identity/v3/projects => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:44.507439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c791b-67bc-45ed-bdac-611aa3b0bdea None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:44.507954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c791b-67bc-45ed-bdac-611aa3b0bdea None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:44.508037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c791b-67bc-45ed-bdac-611aa3b0bdea None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:44.509433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 30/58] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:44.514439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:44.514840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:44.515037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:44.531659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:44.532824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:44.597722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:44.622277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c791b-67bc-45ed-bdac-611aa3b0bdea None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:44.719567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c791b-67bc-45ed-bdac-611aa3b0bdea None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:44.751042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c943888-d8cc-438e-bcea-72ef944fedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:44.751860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943888-d8cc-438e-bcea-72ef944fedb2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:44.752151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943888-d8cc-438e-bcea-72ef944fedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:44.752430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943888-d8cc-438e-bcea-72ef944fedb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:44.753606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c943888-d8cc-438e-bcea-72ef944fedb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:44.755065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c943888-d8cc-438e-bcea-72ef944fedb2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:44.756715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 31/60] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:44.762231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:44.855625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801421c-fabf-418e-9547-06cab1cba2b2 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:44.887769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b990e4-bd2b-47b4-90a2-baa6338f2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:44.888430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b990e4-bd2b-47b4-90a2-baa6338f2b34 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:44.888718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b990e4-bd2b-47b4-90a2-baa6338f2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:44.888995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b990e4-bd2b-47b4-90a2-baa6338f2b34 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:44.889692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b990e4-bd2b-47b4-90a2-baa6338f2b34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:44.891895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b990e4-bd2b-47b4-90a2-baa6338f2b34 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:44.999966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:07:44 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:48.281525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b47fd-c7a6-437e-9963-5bf0527570ad None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.282557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b47fd-c7a6-437e-9963-5bf0527570ad None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.283081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b47fd-c7a6-437e-9963-5bf0527570ad None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.285025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:48.290654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e6c7-524e-4f61-afe5-8d3a86bb7def None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.291568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e6c7-524e-4f61-afe5-8d3a86bb7def None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.292076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8e6c7-524e-4f61-afe5-8d3a86bb7def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.314414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-42c8e6c7-524e-4f61-afe5-8d3a86bb7def None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:48.316118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-42c8e6c7-524e-4f61-afe5-8d3a86bb7def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:48.417049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:48.450654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b47fd-c7a6-437e-9963-5bf0527570ad None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:48.583127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e16fb-9613-41fa-8abd-d8e9719da7e2 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.583369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e16fb-9613-41fa-8abd-d8e9719da7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.583819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e16fb-9613-41fa-8abd-d8e9719da7e2 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.585246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 32/64] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:48.598247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05af7-dcf9-48a5-a968-70861c85666d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.598536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05af7-dcf9-48a5-a968-70861c85666d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.598812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05af7-dcf9-48a5-a968-70861c85666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.609737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b47fd-c7a6-437e-9963-5bf0527570ad None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:48.628284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1eb05af7-dcf9-48a5-a968-70861c85666d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:48.629465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1eb05af7-dcf9-48a5-a968-70861c85666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:48.653436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:48.654498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.654927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.655998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.667411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:48.676547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:48.677607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:48.678587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:48.681225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 33/65] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:48.688113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:48.755347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:48.767878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284206ff-3375-4a0b-8e5c-92bc2c79ca0c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.768367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284206ff-3375-4a0b-8e5c-92bc2c79ca0c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.768808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284206ff-3375-4a0b-8e5c-92bc2c79ca0c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.771046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 34/67] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:48 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:48.783285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17841-fc19-4407-a16c-50f563274ed3 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.783285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17841-fc19-4407-a16c-50f563274ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.783285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f17841-fc19-4407-a16c-50f563274ed3 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.783285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 35/68] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:48.784097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ba41-8e9b-41ba-960f-951146b2a22a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.784545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ba41-8e9b-41ba-960f-951146b2a22a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.786748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ba41-8e9b-41ba-960f-951146b2a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.816604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2b04ba41-8e9b-41ba-960f-951146b2a22a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:48.818004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2b04ba41-8e9b-41ba-960f-951146b2a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:48.819822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281657-498c-4a2e-be37-04062ff925a4 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:48.876716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:48.877316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.877603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.877880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.878628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:48.878934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:48.880358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:48.890909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 36/69] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:48.892353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:48.892651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:48.892935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:48.911245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:48.912485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:48.917154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 34/70] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:48.922877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:48.993091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 37/71] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:48.994274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.051666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a3f72-ae0f-4cfd-a12a-c84a922476ec None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.086163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.087360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.087819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.088268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.098751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:49.103458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61814bb-aa78-4aea-b6e7-dbfebdae24da None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:49.107167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:49.108090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:07:49.109525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:49.112302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 35/72] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:07:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:49.113313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.148460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.149220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.149498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.149773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.164087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:49.174258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:49.175223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 38/73] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:49.181220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.231053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748408d4-403a-4a8c-92eb-b46133f23fac None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.263819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.264716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.265002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.265279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.266470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.267965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.274128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 36/74] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.274128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.286286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcd79c-fb74-4845-b797-9c57ba2e4db8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.321231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.322790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.323280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.323741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.334404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:49.342647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:49.344374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:49.345238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:49.346001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 39/75] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:49.346705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.372949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055f1e9-3a64-43c6-9fe7-ec9a9a1e9d7c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.407586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.408206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.408477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.408759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.409504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:49.409816 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.411208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.418782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.419597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.444974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81ca4-7f9e-4d4f-9a24-e352ecf0d981 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.478371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.479501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.479866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.480150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.481217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:49.481594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.483191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041085ad-e9dc-470c-b3a0-17084030a9a9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.492130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 40/77] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.493448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20841ea-4a3d-4a58-a98e-bf9456fa04cb None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.493745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20841ea-4a3d-4a58-a98e-bf9456fa04cb None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.494030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20841ea-4a3d-4a58-a98e-bf9456fa04cb None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.495298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 41/78] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:49.498912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20841ea-4a3d-4a58-a98e-bf9456fa04cb None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.520896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b79762-8525-4a3d-93d8-522a7f78c5c3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.554724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.555404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.555695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.555977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.595761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20841ea-4a3d-4a58-a98e-bf9456fa04cb None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.620708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.622332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.627482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.628150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.628437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.628716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.629483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:49.629791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.631149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.639689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 42/79] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.640477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.719405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 38/80] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:07:49.720259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.742491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ae1af-0525-4a8f-9fca-4f3cf22512e2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.774541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8f53d-0619-45f7-accf-39e63d211f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.775462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f53d-0619-45f7-accf-39e63d211f62 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.775740 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f53d-0619-45f7-accf-39e63d211f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.776012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f53d-0619-45f7-accf-39e63d211f62 None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.789266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8f53d-0619-45f7-accf-39e63d211f62 None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.790705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8f53d-0619-45f7-accf-39e63d211f62 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.792387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 43/81] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.793526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.793820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.794098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.809415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:49.810570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:49.815619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcd3b3-7ef0-46e0-bb20-777d3d88ffda None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.848756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.849619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.849911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.850189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.851409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.852859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.854468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 39/82] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.855278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.873620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 44/83] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:49.874821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:49.949921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c040f-11e0-4a72-bd79-d1b6c584790b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.979709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85999-0cfd-44ae-81cc-cfa205791250 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:49.982155 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:49.983020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:49.983386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:49.983669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:49.984852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:49.986288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:49.987931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 40/84] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:49.988698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.013059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.013916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.014207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.014984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.016218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.017671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.024349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 45/85] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:50.024349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.089255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fcf94-92af-4dec-97cc-bf59c6fc8937 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.116170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6b85a-c830-4491-86d4-21293d5ef837 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.121625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.122244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.122531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.122811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.149425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.150073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.150359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.150643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.187238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.188737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.213940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.215424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.281584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 41/86] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:07:50.282575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.307657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 46/87] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:07:50.308498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.375230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a92f-0083-4204-baec-037c8422aac7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.400640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd5520-cd6f-473a-9741-ab2ac5076e47 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.409253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.410037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.410584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.410943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.412124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.413588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.415188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 42/88] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:50.420881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.434650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.435338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.435630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.435911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.500251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.501884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.513740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e7ed-066b-4a56-b0ff-b965267a9a3c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.547934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.548520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.548808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.549086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.549908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=bb40ca9c41484170a3eb1edcceb6c0bf) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:50.550223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.551711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.558987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 43/89] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/role_assignments?user.id=bb40ca9c41484170a3eb1edcceb6c0bf&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:50.559795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.603187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 47/90] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:07:50.604441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.671126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193da3-5647-4ddc-b94e-5d8ca30ff2ca None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.707138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.708064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.708354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.708634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.709908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.711418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.712625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb178-786b-49b7-ac52-95a559239b1d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.719553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 44/91] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:50.719553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.750084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.751216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.751553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.751829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.753925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.754461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.756754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 48/92] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:50.756957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.825166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ed88-77fe-412f-8f4e-89bb69ef1f86 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.858061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.858447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e40a-e0b4-40d4-81a5-5789d89cd0d0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:50.858763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.859048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.859358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.860068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.861547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.894249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:50.895101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:50.895659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:50.895939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] PATH_INFO: `/v3/projects/c718b98f77654c9f8f62afbdcbc77b01` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:50.897229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] RBAC: Authorizing `identity:get_project(project_id=c718b98f77654c9f8f62afbdcbc77b01)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:50.898669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:50.900388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/projects/c718b98f77654c9f8f62afbdcbc77b01 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:50.901143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:50.975193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 45/94] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:07:50 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:50.975193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:51.013308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0873856-771e-4aea-8a03-5ae916c89c80 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:51.059081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:51.059788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:51.060072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:51.060346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:51.061180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] RBAC: Adding query filter params (role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=6439f896de0f426b8c65c2ee40200b78) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:51.061549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:51.063738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:51.071548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 50/95] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/role_assignments?user.id=6439f896de0f426b8c65c2ee40200b78&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=aa3a7655caa4456091096e448052a63b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:51.072525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:51.092330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537083b-5391-40ed-9b2f-f5b47c9dbbc0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:51.131528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:51.132392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:51.132847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:51.133222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:51.134212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=6439f896de0f426b8c65c2ee40200b78) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:51.134648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:51.136317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01e6b8-f21e-4140-8621-28d9d218c0a1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:51.143000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 46/96] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:07:50 2022] GET /identity/v3/role_assignments?user.id=6439f896de0f426b8c65c2ee40200b78&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:51.204898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aaa5a-42ec-4ec6-9fb5-ab0fa6887008 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:51.251235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:51.251999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:51.252290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:51.252566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:51.253427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=c718b98f77654c9f8f62afbdcbc77b01, user.id=6439f896de0f426b8c65c2ee40200b78) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:51.253744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:51.255288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053424d-7d72-491f-9c5c-8db83a37a74d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:51.262057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 51/97] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:07:51 2022] GET /identity/v3/role_assignments?user.id=6439f896de0f426b8c65c2ee40200b78&scope.project.id=c718b98f77654c9f8f62afbdcbc77b01&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:53.354968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442fe4-c4c4-4b98-9931-cd2d4eac4cc3 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:53.355712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442fe4-c4c4-4b98-9931-cd2d4eac4cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:53.355712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442fe4-c4c4-4b98-9931-cd2d4eac4cc3 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:53.356939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 47/98] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:53.372997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:53.373620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:53.373620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:53.394553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:53.396114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:53.552208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 52/99] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:53.587959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442fe4-c4c4-4b98-9931-cd2d4eac4cc3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:53.733082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442fe4-c4c4-4b98-9931-cd2d4eac4cc3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:53.778874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a9f52-6f91-4367-9b77-1ca6b2867196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:53.779713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a9f52-6f91-4367-9b77-1ca6b2867196 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:53.780109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a9f52-6f91-4367-9b77-1ca6b2867196 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:53.780888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a9f52-6f91-4367-9b77-1ca6b2867196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:53.796441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a9f52-6f91-4367-9b77-1ca6b2867196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-934a9f52-6f91-4367-9b77-1ca6b2867196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:53.804183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:53.806501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:53.808402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 48/100] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:07:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:53.816404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:53.888954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be83d-89a4-4ffe-a66c-aada3480d260 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:53.889271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be83d-89a4-4ffe-a66c-aada3480d260 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:53.890100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be83d-89a4-4ffe-a66c-aada3480d260 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:53.891640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 49/101] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:53.897199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:53.897492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:53.897773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:53.928299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:53.929523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:53.951601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2bad-af65-4c2c-90e5-702968a8763a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:53.987377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:53.988659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:53.989259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:53.989738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:53.990728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:53.991270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:53.992913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ae47-75e2-4f25-b909-37b2b9d41c98 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.003094 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 53/102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:54.004767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882fcce-9521-4e4a-b5d8-9f8747ede957 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.005276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882fcce-9521-4e4a-b5d8-9f8747ede957 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.005752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882fcce-9521-4e4a-b5d8-9f8747ede957 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.007194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 54/103] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:54.015343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.016039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.017724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.035555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:54.037023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:54.066074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 50/104] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:54.067009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.132376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 55/105] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:54.133471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.278567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c398-1b29-453d-b02c-fb5eec608849 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.322911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d163035-98be-49d9-a014-eb0d893d039c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.324983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.325872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.326159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.326440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.329702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:54.331194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.332899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 51/106] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:54.333669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.367369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.368186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.368636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.369060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.380117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:54.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:54.390477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:07:54.391277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:54.393172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 56/107] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:54.394096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.446114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4edf59-6736-41ac-a5ac-b5eac81b7705 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.481447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0804274-d276-40a8-bf36-4433f857a461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.482513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804274-d276-40a8-bf36-4433f857a461 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.482846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804274-d276-40a8-bf36-4433f857a461 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.483712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804274-d276-40a8-bf36-4433f857a461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.497270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cbd3f-85c0-4747-94d7-c9495e0b734f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.497574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0804274-d276-40a8-bf36-4433f857a461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-c0804274-d276-40a8-bf36-4433f857a461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:54.507222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:54.508309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:54.509115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 52/108] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:54.509960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1b0a4-0a6a-48bf-b015-9aa6e5f53228 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.510415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1b0a4-0a6a-48bf-b015-9aa6e5f53228 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.510823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1b0a4-0a6a-48bf-b015-9aa6e5f53228 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.517603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 53/109] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:54.518486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1b0a4-0a6a-48bf-b015-9aa6e5f53228 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.552539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.553341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.554091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.554824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.556385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:54.558582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.566643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 57/110] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:54.568522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.645171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1b0a4-0a6a-48bf-b015-9aa6e5f53228 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.691014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.692080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.692566 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.693036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.693979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:54.694477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:54.696119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946178a-69fc-4c02-b111-2ca6f7cc05c0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.700496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4667436-070e-471c-bf1a-137b935683b9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.706574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 54/111] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:54.708203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.709195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.709700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.731713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:54.733575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:54.736296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.736979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.737273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.737611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.738373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:54.738736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:54.740249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.750448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 58/112] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:54.751350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.811658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 55/113] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:54.812909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:54.854863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac73b-6580-4817-80e6-909bad5b0e8d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.888917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.890565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.890859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.891143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/bb40ca9c41484170a3eb1edcceb6c0bf/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.893211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] RBAC: Authorizing `identity:create_grant(project_id=b9514039f9ea4ae396dba2f3c31b7ad1, user_id=bb40ca9c41484170a3eb1edcceb6c0bf, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:54.894734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.915492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eefe3b-d4ba-4274-9b3b-2e5a1867db1f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:54.948907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:54.950092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:54.950593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:54.951079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:54.952670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:54.954340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:54.956189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 56/114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:54.957176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.011767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 59/115] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:07:54 2022] PUT /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/bb40ca9c41484170a3eb1edcceb6c0bf/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:07:55.014570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.130153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c05659-29b5-404e-9101-1ddbec7c6fc2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.191385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.192689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.193182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.193652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.195117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:55.196662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:55.198553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 57/116] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:54 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:55.198687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517299-2f41-43c4-b0c0-92fa1535affb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.199875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.235054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edda3db-8fb6-4fa8-b80f-8a3d782a7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.235903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda3db-8fb6-4fa8-b80f-8a3d782a7e66 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.236189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda3db-8fb6-4fa8-b80f-8a3d782a7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.236467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda3db-8fb6-4fa8-b80f-8a3d782a7e66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.248755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edda3db-8fb6-4fa8-b80f-8a3d782a7e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5edda3db-8fb6-4fa8-b80f-8a3d782a7e66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:55.256910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:55.257790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:55.258568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 60/117] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:55.260158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce20f2-fe64-46ec-b564-dc349f8f73e5 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.260158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce20f2-fe64-46ec-b564-dc349f8f73e5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.260158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce20f2-fe64-46ec-b564-dc349f8f73e5 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.261323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 61/118] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:55.262739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39af37-6c01-469a-b5ce-d60a48e46ef9 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.262739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39af37-6c01-469a-b5ce-d60a48e46ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.262911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39af37-6c01-469a-b5ce-d60a48e46ef9 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 62/119] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:55.265499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39af37-6c01-469a-b5ce-d60a48e46ef9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.308212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477746-fc3e-443f-8084-335b550e125e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.341759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.343174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.343527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.343760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.348016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:55.349571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:55.351525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 58/120] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:55 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:55.352072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.377414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39af37-6c01-469a-b5ce-d60a48e46ef9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.415346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b437f-8c5f-4ec5-b523-92d1423cd8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.416136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b437f-8c5f-4ec5-b523-92d1423cd8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.416417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b437f-8c5f-4ec5-b523-92d1423cd8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.416688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b437f-8c5f-4ec5-b523-92d1423cd8c3 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.417912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b437f-8c5f-4ec5-b523-92d1423cd8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:55.419403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b437f-8c5f-4ec5-b523-92d1423cd8c3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:55.426328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 63/121] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:55 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:55.426328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.426328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.426328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.442395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:55.443635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:55.458558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfccce-7d4f-4e91-b62e-8784cf9f9951 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.494002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.494678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.494968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.495245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.496231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:55.496549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:55.497940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7707ac-cfcb-4126-95a6-0a8d1bfb4def None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:55.511749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 59/122] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:55.511749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.511749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.511749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.520984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 64/123] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:55.521816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.529002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:55.530289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:55.611084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 60/124] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:55.611084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.630404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eee08-4d61-4e08-abc7-adb96ea623d4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.665979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.667130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.667516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.667866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/6439f896de0f426b8c65c2ee40200b78/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.670165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b9514039f9ea4ae396dba2f3c31b7ad1, user_id=6439f896de0f426b8c65c2ee40200b78, role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:55.672939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:55.710467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc1c53-b86a-4b29-a92c-33b4b5b75704 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.745456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.746352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.746650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.746925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/6439f896de0f426b8c65c2ee40200b78/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.749682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] RBAC: Authorizing `identity:create_grant(project_id=b9514039f9ea4ae396dba2f3c31b7ad1, user_id=6439f896de0f426b8c65c2ee40200b78, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:55.751199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:55.802118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 65/125] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:07:55 2022] PUT /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/6439f896de0f426b8c65c2ee40200b78/roles/aa3a7655caa4456091096e448052a63b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:07:55.813185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.836928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 61/126] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:07:55 2022] PUT /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/6439f896de0f426b8c65c2ee40200b78/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:07:55.838339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:55.927744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290c6ce-1e2d-487c-9538-77585c3638ef None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.954387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcab3d-14c4-40ed-beca-0404f9bf2eda None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:55.992167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.993360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.993787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.994217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.994572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:55.997827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:55.997827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:55.997827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:55.999901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.001699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.003777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 66/127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:55 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:56.004777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.011142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:56.019445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:56.020860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:07:56.021823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:56.030272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 62/128] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:07:56.030272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.135451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8cc4c-e231-4dc0-a429-151eec4e41b0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.138832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456e3a-cbd5-4cd2-8eda-4534a746af4b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.171623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.172641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.173129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.173583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] PATH_INFO: `/v3/projects/c718b98f77654c9f8f62afbdcbc77b01` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.175193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] RBAC: Authorizing `identity:get_project(project_id=c718b98f77654c9f8f62afbdcbc77b01)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.176863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.177145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.178056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.178483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.178920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.179682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 63/129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:56 2022] GET /identity/v3/projects/c718b98f77654c9f8f62afbdcbc77b01 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:56.180436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.180703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.182182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.184222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 67/130] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:56.185127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.284074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f110dc-06d7-41fa-a40c-f959e1281c5c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.286053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e17a-5f15-496e-b5be-0c1af3f6aa56 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.320676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.321473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.321821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.322108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.322971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:56.323301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.323720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.324719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.325071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.325547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.326026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] PATH_INFO: `/v3/projects/c718b98f77654c9f8f62afbdcbc77b01/users/6439f896de0f426b8c65c2ee40200b78/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.329365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] RBAC: Authorizing `identity:create_grant(project_id=c718b98f77654c9f8f62afbdcbc77b01, user_id=6439f896de0f426b8c65c2ee40200b78, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.331063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.335769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 64/131] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:07:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:56.339301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.417735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:07:56 2022] PUT /identity/v3/projects/c718b98f77654c9f8f62afbdcbc77b01/users/6439f896de0f426b8c65c2ee40200b78/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:07:56.418758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.443847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b60e-1b19-492c-b0a5-af2848612215 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.481952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.483832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.484311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.484751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.485671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.487379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.569967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6d2cf-3e2c-4e22-8340-d2c5caf5319d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.614513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 65/133] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:07:56 2022] POST /identity/v3/projects => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:07:56.615344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.616571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.616856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.617130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] PATH_INFO: `/v3/users/8a4e6a3d709e485089da63df8577396c` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.633686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8a4e6a3d709e485089da63df8577396c)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.635194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:56.637034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 69/134] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:56 2022] GET /identity/v3/users/8a4e6a3d709e485089da63df8577396c => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:56.643527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:56.778933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d43199-3aef-4899-9e86-ec2ae3cadff5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:56.830396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:56.831061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:56.831377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:56.831660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:56.913166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:56.914639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:57.039274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 66/135] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:07:57.045245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:57.153172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024312a1-37c7-40c4-973e-8d5008fd63b2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:57.194835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f5d7-2e8f-4000-9ef6-10d83e9291dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:57.195742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f5d7-2e8f-4000-9ef6-10d83e9291dd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:57.196029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f5d7-2e8f-4000-9ef6-10d83e9291dd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:57.196306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f5d7-2e8f-4000-9ef6-10d83e9291dd None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:57.197532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f5d7-2e8f-4000-9ef6-10d83e9291dd None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:57.198987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f5d7-2e8f-4000-9ef6-10d83e9291dd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:57.200951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 70/136] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:57 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:57.207074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:57.323751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0fb32-e5d6-414f-9db7-f2ba40994c4c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:57.377240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:57.377904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:57.378190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:57.378472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:57.379388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] RBAC: Adding query filter params (role.id=1e187930497e4bd3af06094b1540c1db, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=8a4e6a3d709e485089da63df8577396c) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:57.379709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:57.381163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b624d08-951c-4399-8986-11b4dece6b2f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:57.392296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 67/137] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:07:57 2022] GET /identity/v3/role_assignments?user.id=8a4e6a3d709e485089da63df8577396c&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=1e187930497e4bd3af06094b1540c1db => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:57.924745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885773f-8890-435c-9108-dad40a5b44ef None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:57.925287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885773f-8890-435c-9108-dad40a5b44ef None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:57.925287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885773f-8890-435c-9108-dad40a5b44ef None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:57.926696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 71/138] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:57.932533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:57.933101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:57.933101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:57.957904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:57.959118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:58.036054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 68/139] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:58.079230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885773f-8890-435c-9108-dad40a5b44ef None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:58.205048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885773f-8890-435c-9108-dad40a5b44ef None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:58.249300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:58.250100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:58.250384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:58.250657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:58.264322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:58.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:58.274336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:58.276314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 72/140] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:07:58.283769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:58.414512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b3e8-5451-42d2-92e7-f706d15713ef None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:58.457222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:58.457820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:58.458106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:58.458386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:58.459150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:58.459485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:58.461077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:58.475118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 69/141] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:58.481103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:58.633404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991558f-b112-49f8-91b1-5107e04039ee None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:58.669253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:58.670140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:58.670952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:58.671224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] PATH_INFO: `/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:58.672476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] RBAC: Authorizing `identity:get_user(user_id=bb40ca9c41484170a3eb1edcceb6c0bf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:58.673943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:58.675882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 73/142] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:58 2022] GET /identity/v3/users/bb40ca9c41484170a3eb1edcceb6c0bf => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:58.681637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:58.788936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb5313-541c-44fe-b36a-4b5f4bc3ea80 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:58.827973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715772db-4cfd-4079-86c9-b6c27e30f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:58.828689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715772db-4cfd-4079-86c9-b6c27e30f29f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:58.828981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715772db-4cfd-4079-86c9-b6c27e30f29f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:58.829245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715772db-4cfd-4079-86c9-b6c27e30f29f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:58.908739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715772db-4cfd-4079-86c9-b6c27e30f29f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:58.910259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715772db-4cfd-4079-86c9-b6c27e30f29f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:59.034590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:07:59.040689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:59.050162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810befc-5b55-4efd-948c-1e5c1f77f100 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.050512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810befc-5b55-4efd-948c-1e5c1f77f100 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.050799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810befc-5b55-4efd-948c-1e5c1f77f100 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.052199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 71/144] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:07:59.057120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.057414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.057699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.075009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:59.076269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:59.200381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a1d70-806e-45dc-9a1a-3d800ace21e8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:59.213178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 72/145] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:07:59.245862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:59.246740 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.247030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.247336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.249229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:59.250779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:59.252132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:59.260551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 74/146] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:59.268524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:59.408061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6aac3-3e93-4f33-97c6-ba445bb15f02 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:59.443159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:59.443910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.444197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.444476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.445318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=bb40ca9c41484170a3eb1edcceb6c0bf) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:59.445634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:59.447101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841660e-83a8-4691-a317-d92d7c4c4b42 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:59.454038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 75/147] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/role_assignments?user.id=bb40ca9c41484170a3eb1edcceb6c0bf&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:59.456389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43c81a-0615-44bd-9022-4f644971351d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:59.488939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45115a-58ff-4ad5-b155-42a382f4c431 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.489331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45115a-58ff-4ad5-b155-42a382f4c431 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.489758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45115a-58ff-4ad5-b155-42a382f4c431 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.491359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 76/148] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:07:59.496744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.497102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.497452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.516045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:07:59.517427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:07:59.539986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:59.540813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.541186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.541468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.572277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:59.589233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:59.590161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:07:59.590913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 73/149] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:07:59.596937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:07:59.600351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:59.634635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:59.783755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403491b9-a5c7-40f0-86ab-a0b79d48d5f5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:59.846610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0890f-e926-4093-aa19-7348b65efe8f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:07:59.849563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:59.850278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.850567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.850844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.851628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:07:59.852125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:07:59.853687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:07:59.869547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 74/151] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:07:59.876409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:07:59.920277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:07:59.921923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:07:59.922394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:07:59.922839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:07:59.937871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:07:59.947944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:07:59.948879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:07:59.949624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:07:59.953406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 78/152] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:07:59.960240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.084953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb0ad-0e62-4008-a242-90d859d538e8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.085763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33aaba-97be-4c6d-9aa2-c3b59213f345 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.126889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.127923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.128418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.129194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.130695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:00.131366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.133411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.139718 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.141361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.141828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.142282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.143882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.145920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.147946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 75/153] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:00.149583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 79/154] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:07:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:00.153828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.159681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.278834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d80e1-a60c-4dca-ab9d-0c0749133686 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.283527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3414a-fad4-483b-b591-7f233e20f67a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.313886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea14bef-97d2-4d01-800e-b3850e2f569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.314761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14bef-97d2-4d01-800e-b3850e2f569d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.315045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14bef-97d2-4d01-800e-b3850e2f569d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.315348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea14bef-97d2-4d01-800e-b3850e2f569d None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.316172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5146f-ff04-4f6c-bac7-08f795d26f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.316606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea14bef-97d2-4d01-800e-b3850e2f569d None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.316821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5146f-ff04-4f6c-bac7-08f795d26f7d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.317107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5146f-ff04-4f6c-bac7-08f795d26f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.317385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5146f-ff04-4f6c-bac7-08f795d26f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.318106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea14bef-97d2-4d01-800e-b3850e2f569d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.324257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 80/155] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:00.324257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c20aab-5fbb-446e-8c8c-4b4d968a1dc8 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.324257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c20aab-5fbb-446e-8c8c-4b4d968a1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.324257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c20aab-5fbb-446e-8c8c-4b4d968a1dc8 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.324257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 81/156] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:00.324257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656013a-28ad-4adf-9b42-17d79763e075 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.324674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656013a-28ad-4adf-9b42-17d79763e075 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.324674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656013a-28ad-4adf-9b42-17d79763e075 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.325954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 82/157] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:00.327125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656013a-28ad-4adf-9b42-17d79763e075 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.393648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5146f-ff04-4f6c-bac7-08f795d26f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.395306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5146f-ff04-4f6c-bac7-08f795d26f7d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.432826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656013a-28ad-4adf-9b42-17d79763e075 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.466839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.468374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.468809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.469093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.499096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:00.499096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0f1e0-8224-44ec-9dfb-a55477950a4d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.499096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0f1e0-8224-44ec-9dfb-a55477950a4d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.499096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0f1e0-8224-44ec-9dfb-a55477950a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.516837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0cc0f1e0-8224-44ec-9dfb-a55477950a4d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:00.518025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0cc0f1e0-8224-44ec-9dfb-a55477950a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:00.547835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.549329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.590117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 77/159] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:00.591461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.591750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.592053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.608300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:00.609490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:00.661883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 83/160] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:00.662991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.687299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 78/161] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:00.687299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.780794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe6e23-10de-490b-9193-8e0fc0cf99ce None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.788656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bc296-1cdc-4b41-9a0c-5ebf153933c5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.815777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.816634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.816921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.817192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.818379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.819869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.827104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 84/162] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:00.827104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.828248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.829062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.829347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.829626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.830845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.832369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.838343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 79/163] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:00.838343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.930003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13afe6-8c7e-4045-beef-cd342c979f14 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.938157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91ac0-1765-44da-83c6-787b9246e635 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:00.962516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.963397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.963684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.963959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.965150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:00.966602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:00.969201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:00.969868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:00.971336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:00.972124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:00.972403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:00.972675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:00.982650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:00.990530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:00.991426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:00.992282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:00.992922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.068092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c7cb9-5dec-43d7-aa56-039741b6475e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.089726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cc3ff-218c-48a4-9abb-ab69902391a4 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.099181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.099852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.100128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.100396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.101203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] RBAC: Adding query filter params (role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=6439f896de0f426b8c65c2ee40200b78) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:01.101506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.102917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3140c-8a21-4a69-8839-48462364a50b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.109105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:00 2022] GET /identity/v3/role_assignments?user.id=6439f896de0f426b8c65c2ee40200b78&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=aa3a7655caa4456091096e448052a63b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:01.110457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e133-f60a-4efc-9a7d-fd22bd2e8f97 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.111979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e133-f60a-4efc-9a7d-fd22bd2e8f97 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.111979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e133-f60a-4efc-9a7d-fd22bd2e8f97 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.113286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 87/167] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:01.113474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893e133-f60a-4efc-9a7d-fd22bd2e8f97 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.130353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.131043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.131357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.131635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.132426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.133919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.222787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893e133-f60a-4efc-9a7d-fd22bd2e8f97 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.258673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.259368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.259656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.259937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.260785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=6439f896de0f426b8c65c2ee40200b78) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:01.261099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.262557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d8079-83a8-4fe8-ae74-df769e43433d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.265500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 81/168] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:00 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:01.270632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 88/169] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/role_assignments?user.id=6439f896de0f426b8c65c2ee40200b78&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:01.270632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.270632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.270632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.275841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.309789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:01.311868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:01.390976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 89/170] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:01.414674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.425615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21241d5c-5922-4bc3-8967-528a9fe19d10 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.467543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.468272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.468762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.469052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.469912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:01.470228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.471808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.481924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 82/171] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:01.487874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.531826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa238-f602-454e-8725-012a0b5e31fc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.577915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.578677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.578960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.579239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.591212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:01.600229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:01.601126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:01.602076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 90/172] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:01.607427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.613153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47884f-d58b-4889-a2c7-01310c93738d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.660690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.661846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.662288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.662568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] PATH_INFO: `/v3/users/6439f896de0f426b8c65c2ee40200b78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.663906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] RBAC: Authorizing `identity:get_user(user_id=6439f896de0f426b8c65c2ee40200b78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.665375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.667016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 83/173] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/users/6439f896de0f426b8c65c2ee40200b78 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:01.673268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.729053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c947dd-d751-42b9-aecd-992195e5d81c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.772703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.773707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.774208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.774684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.775706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:01.776216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.778502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.788060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 91/174] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:01.794787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:01.798722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b03308-bba9-4536-ac16-cae3b010a7e9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.850308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.851402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.851976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.852476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.923230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2a18-94b5-41bb-b14e-f9a1ce2a08c4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:01.954859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.956538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.976547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:01.977773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:01.978262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:01.978735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] PATH_INFO: `/v3/users/8a4e6a3d709e485089da63df8577396c` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:01.984153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] RBAC: Authorizing `identity:get_user(user_id=8a4e6a3d709e485089da63df8577396c)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:01.985866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:01.987840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 92/175] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/users/8a4e6a3d709e485089da63df8577396c => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:01.993276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:02.056877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 84/176] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:02.062006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:02.164905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37752e-6b44-4e7b-a0ba-d50a044f244f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:02.201122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:02.202553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:02.202896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:02.203173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:02.204397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:02.205835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:02.207862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 93/177] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:01 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:02.213693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:02.237365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182e2d2-8a63-43e6-820a-642319e3b4a5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:02.319760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540ff5-a392-4a4a-846e-3e878b2669f9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:02.332538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:02.333735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:02.334220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:02.334714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] PATH_INFO: `/v3/projects/c718b98f77654c9f8f62afbdcbc77b01` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:02.339981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] RBAC: Authorizing `identity:get_project(project_id=c718b98f77654c9f8f62afbdcbc77b01)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:02.341663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:02.344513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 85/178] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:02 2022] GET /identity/v3/projects/c718b98f77654c9f8f62afbdcbc77b01 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:02.352017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:02.359011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c2973-53ea-4b3a-85f1-af5b890d5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:02.359942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c2973-53ea-4b3a-85f1-af5b890d5169 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:02.360224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c2973-53ea-4b3a-85f1-af5b890d5169 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:02.360498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c2973-53ea-4b3a-85f1-af5b890d5169 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/8a4e6a3d709e485089da63df8577396c/roles/1e187930497e4bd3af06094b1540c1db` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:02.362604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c2973-53ea-4b3a-85f1-af5b890d5169 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9514039f9ea4ae396dba2f3c31b7ad1, user_id=8a4e6a3d709e485089da63df8577396c, role_id=1e187930497e4bd3af06094b1540c1db)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:02.364959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c2973-53ea-4b3a-85f1-af5b890d5169 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:02.453532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 94/179] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:02 2022] PUT /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/users/8a4e6a3d709e485089da63df8577396c/roles/1e187930497e4bd3af06094b1540c1db => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:02.466006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dc445-d30e-4dc3-a4bb-88cf5cad66bd None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:02.508580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:02.508580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:02.508580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:02.508580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:02.509050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=c718b98f77654c9f8f62afbdcbc77b01, user.id=6439f896de0f426b8c65c2ee40200b78) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:02.509050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:02.509050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d2e6-d1b2-4ba0-9909-99409f4f672d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:02.514841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 86/180] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:02 2022] GET /identity/v3/role_assignments?user.id=6439f896de0f426b8c65c2ee40200b78&scope.project.id=c718b98f77654c9f8f62afbdcbc77b01&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:03.951975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13bf91-b36a-4564-9989-ce8a96578004 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:03.952693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13bf91-b36a-4564-9989-ce8a96578004 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:03.952693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13bf91-b36a-4564-9989-ce8a96578004 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:03.954240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 95/181] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:03.959956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e01349-66e5-4259-b948-2fbb6b2db40f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:03.960472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e01349-66e5-4259-b948-2fbb6b2db40f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:03.960547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e01349-66e5-4259-b948-2fbb6b2db40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:03.978849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-58e01349-66e5-4259-b948-2fbb6b2db40f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:03.980072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-58e01349-66e5-4259-b948-2fbb6b2db40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:04.055339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 87/182] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:04.071231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13bf91-b36a-4564-9989-ce8a96578004 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.093817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188f0f-33d1-4973-b03c-f464e6c04b38 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.094149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188f0f-33d1-4973-b03c-f464e6c04b38 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.094384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44188f0f-33d1-4973-b03c-f464e6c04b38 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.095809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 88/183] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:04.100801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340271cc-bf7b-4a40-92c0-15bbadccf613 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.101306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340271cc-bf7b-4a40-92c0-15bbadccf613 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.101757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340271cc-bf7b-4a40-92c0-15bbadccf613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.118338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-340271cc-bf7b-4a40-92c0-15bbadccf613 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:04.119747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-340271cc-bf7b-4a40-92c0-15bbadccf613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:04.179635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13bf91-b36a-4564-9989-ce8a96578004 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.187288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 89/184] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:04.199302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9676cd-10cd-4f05-a3bc-0f36bb23cda2 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.199302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9676cd-10cd-4f05-a3bc-0f36bb23cda2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.199302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9676cd-10cd-4f05-a3bc-0f36bb23cda2 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.199302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 90/185] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:04.206192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.206871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.207346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.215575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.216363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.216703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.217598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.226501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:04.227475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:04.228063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:04.235019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:04.236155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:04.237146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 96/186] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:04.241575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.298801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 91/187] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:04.307459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.352871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcee5-7eb7-42da-998f-38cca649b04a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.388159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.389805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.390197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.390476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.391675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:04.393133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:04.395157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 97/188] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:04.398825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4b819-a526-4c3c-9620-69c0e2a27f08 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.400033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.432627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.433342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.433623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.433928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.434832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:04.435141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:04.437061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:04.445470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 92/189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:04.446260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.509107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999f59-9418-45f7-8551-c91a1169df49 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.542934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.543779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.544065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.544338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.554626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:04.561824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d088-fd1d-486e-ab59-46977d54394b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:04.563368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:04.564243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:04.565038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 98/190] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:04.566321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.598944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.599896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.600181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.600464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.601168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:04.602615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:04.665825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfa10c-c41a-47af-838c-9563382d20f1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.699055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.699954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.700239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.700513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] PATH_INFO: `/v3/users/15f4f3f309ae4dddace4d43c83d915af` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.713575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=15f4f3f309ae4dddace4d43c83d915af)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:04.715045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:04.715747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 93/191] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:04 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:04.717040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 99/192] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/users/15f4f3f309ae4dddace4d43c83d915af => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:04.722695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.724474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.850629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41d608-cfc1-4f04-955e-72f38df68fe3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.866746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666eb1e-2123-4943-8813-ed9dafe02ec1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:04.894672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.895333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.895663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.896015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.896856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:04.897245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:04.898705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:04.908281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 94/193] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:04.913584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab7eef-ffb1-4d60-9704-235ebd411836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:04.914456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab7eef-ffb1-4d60-9704-235ebd411836 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:04.914675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:04.914774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab7eef-ffb1-4d60-9704-235ebd411836 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:04.915008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab7eef-ffb1-4d60-9704-235ebd411836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:04.993092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab7eef-ffb1-4d60-9704-235ebd411836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:04.994564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab7eef-ffb1-4d60-9704-235ebd411836 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.033254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750653-9ff0-4369-b1e6-64dae45357f0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.074044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012abd-ce25-484a-a855-466460992a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.075225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012abd-ce25-484a-a855-466460992a41 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.075707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012abd-ce25-484a-a855-466460992a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.075978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012abd-ce25-484a-a855-466460992a41 None admin] PATH_INFO: `/v3/users/15f4f3f309ae4dddace4d43c83d915af` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.077836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012abd-ce25-484a-a855-466460992a41 None admin] RBAC: Authorizing `identity:get_user(user_id=15f4f3f309ae4dddace4d43c83d915af)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.079337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012abd-ce25-484a-a855-466460992a41 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.081154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 95/194] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/users/15f4f3f309ae4dddace4d43c83d915af => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:05.082172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6735cd-35c4-4b28-b699-cc416e3e6dfb None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.082458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6735cd-35c4-4b28-b699-cc416e3e6dfb None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.082734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6735cd-35c4-4b28-b699-cc416e3e6dfb None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.088380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 96/195] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:05.090234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6735cd-35c4-4b28-b699-cc416e3e6dfb None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.101964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 100/196] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:05.104174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.104706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.105435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.127728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:05.129569 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:05.211578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6735cd-35c4-4b28-b699-cc416e3e6dfb None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.221402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 101/197] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:05.222614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.273410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.274278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.274663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.275057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.345356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065565cb-eb86-4cfc-8a05-c2005d597167 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.349772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.351370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.386430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.386899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.387296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.387676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.389006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.390518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.392583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 102/198] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:05.393431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.459856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 97/199] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:05.460989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.494869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ad038-918b-4225-a7d9-3f46df8d363d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.530185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.531189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.531598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.531969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.543061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:05.552218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:05.553342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:05.554349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:05.556402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 103/200] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:05.563951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.573976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8bcbb-4559-471a-a8e8-ca5ed13f05b7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.610823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.611837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.612281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.612702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.613689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=15f4f3f309ae4dddace4d43c83d915af) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:05.614147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.615827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.625231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 98/201] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/role_assignments?user.id=15f4f3f309ae4dddace4d43c83d915af&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:05.626367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.674953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fc945-c412-4041-b06a-58bed7b7f2bf None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.710290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.711382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.711760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.712128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.713441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.714978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.717757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 104/202] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:05.725869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.760659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5c398-5a26-4438-950d-e25458af2923 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.833123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.834258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.834781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.835288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.836301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:05.836826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.838616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.855736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 99/203] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:05.863454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:05.920770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a016e-6ba2-4a24-8f78-6b288457fb52 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:05.965074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:05.965664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:05.965931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:05.966204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:05.967683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] RBAC: Adding query filter params (role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=15f4f3f309ae4dddace4d43c83d915af) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:05.967966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:05.969401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:05.987360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 105/204] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/role_assignments?user.id=15f4f3f309ae4dddace4d43c83d915af&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=aa3a7655caa4456091096e448052a63b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:05.996824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f069-c82a-4bb6-822e-dd5bf7801337 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:06.054792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:06.056559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:06.057047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:06.057524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] PATH_INFO: `/v3/users/8a4e6a3d709e485089da63df8577396c` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:06.058935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] RBAC: Authorizing `identity:get_user(user_id=8a4e6a3d709e485089da63df8577396c)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:06.060898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:06.062868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 100/205] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:05 2022] GET /identity/v3/users/8a4e6a3d709e485089da63df8577396c => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:06.068650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:06.191150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c73a-db76-496a-a7fe-eab1d7a4a091 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:06.235058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:06.236302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:06.236805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:06.237303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:06.309965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:06.312155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:06.410270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 106/206] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:06.415646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:06.567730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a247f-0b2a-4f56-b750-7f1bdc552834 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:06.618327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b608a-4eca-4a08-a33e-6875cfb2ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:06.619193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b608a-4eca-4a08-a33e-6875cfb2ce96 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:06.619499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b608a-4eca-4a08-a33e-6875cfb2ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:06.619770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b608a-4eca-4a08-a33e-6875cfb2ce96 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:06.620970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b608a-4eca-4a08-a33e-6875cfb2ce96 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:06.622429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b608a-4eca-4a08-a33e-6875cfb2ce96 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:06.624505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 101/207] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:06 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:06.629878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:06.771104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7fcd7-0c2b-4323-93c0-0e0c2da167e9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:06.823709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:06.824406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:06.824709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:06.825071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:06.825901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] RBAC: Adding query filter params (role.id=1e187930497e4bd3af06094b1540c1db, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1, user.id=8a4e6a3d709e485089da63df8577396c) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:06.826472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:06.828064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c2f2c-65ce-45cf-8f14-93c14ce03e20 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:06.834548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 107/208] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:06 2022] GET /identity/v3/role_assignments?user.id=8a4e6a3d709e485089da63df8577396c&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=1e187930497e4bd3af06094b1540c1db => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:07.488398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df4efc-c321-46e3-80e3-189ba25e856c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.520219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df4efc-c321-46e3-80e3-189ba25e856c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.520219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df4efc-c321-46e3-80e3-189ba25e856c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.520219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 102/209] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:07.521374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.521374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.521374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.521374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:07.522238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:07.570902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2273139-ac47-4d0c-970e-f198b099e18a None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.571230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2273139-ac47-4d0c-970e-f198b099e18a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.571496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2273139-ac47-4d0c-970e-f198b099e18a None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.572856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 103/210] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:07.580608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.580897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.581182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.599389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:07.600564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:07.600838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 108/211] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:07.622856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:07.672710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 104/212] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:07.698087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:07.732187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012bd06-b715-4048-8658-8f6b0ba876c4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:07.768794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:07.770244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.770734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.771205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.782452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:07.790717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:07.791701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:07.792517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:07.795453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 109/213] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:07.801415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:07.801826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313d22-d03c-4da2-8802-bf9cbc31a9c4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:07.838039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:07.838760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.839342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.839469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.840584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:07.842157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:07.844214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 105/214] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:07.853544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:07.927192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8c29-b86b-4606-b489-2ea7717db1ca None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:07.961975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:07.962757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:07.963112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:07.963482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:07.964295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:07.964668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:07.966191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:07.975276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 110/215] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:07.978212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174c99-3180-4c24-820e-c808c037ed8d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:07.981520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.021334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4babad-f6a7-440b-807b-c056c83a4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4babad-f6a7-440b-807b-c056c83a4b06 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.022805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4babad-f6a7-440b-807b-c056c83a4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.023282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4babad-f6a7-440b-807b-c056c83a4b06 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.024176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4babad-f6a7-440b-807b-c056c83a4b06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:08.026205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4babad-f6a7-440b-807b-c056c83a4b06 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:08.085084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0def3d0-a7f9-4285-9932-0fed85a0b0f5 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.123184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.124170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.124456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.124728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] PATH_INFO: `/v3/users/796e8a95c8ee4773a5f3e450fc2a3dbd` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.138674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=796e8a95c8ee4773a5f3e450fc2a3dbd)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:08.140177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:08.142158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 111/216] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:07 2022] GET /identity/v3/users/796e8a95c8ee4773a5f3e450fc2a3dbd => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:08.147715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.163371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 106/217] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:07 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:08.275557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabf365-92d1-4dbb-b16d-80fcc163e1a0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.291778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983994d2-e090-48c6-b0e5-09d3f3d4b8b3 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.292124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983994d2-e090-48c6-b0e5-09d3f3d4b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.292356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983994d2-e090-48c6-b0e5-09d3f3d4b8b3 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.294024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 107/218] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:08.299852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.300382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.300806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.318764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.319448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.319735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.320021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.320478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:08.322054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:08.392710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:08.394232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:08.403399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 108/219] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:08.427649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.518878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 112/220] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:08.525549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.556555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b54358-905e-4a13-8717-076ecae7a29d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.592465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e530-6028-46e4-b67b-59cebf649db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.593425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e530-6028-46e4-b67b-59cebf649db2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.593801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e530-6028-46e4-b67b-59cebf649db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.594226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e530-6028-46e4-b67b-59cebf649db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.604967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e530-6028-46e4-b67b-59cebf649db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d949e530-6028-46e4-b67b-59cebf649db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:08.614432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:08.615437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:08.616215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 109/221] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:08.617347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a567-6f95-4450-b28c-eb2780bd8b44 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.617532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a567-6f95-4450-b28c-eb2780bd8b44 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.618654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a567-6f95-4450-b28c-eb2780bd8b44 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.619285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 110/222] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:08.624430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a567-6f95-4450-b28c-eb2780bd8b44 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.632134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9a35b-99f5-43e4-85cd-5dbfbce4299d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.673500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99431f1-fb30-4148-9930-db3b4472625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.674781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99431f1-fb30-4148-9930-db3b4472625a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.675359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99431f1-fb30-4148-9930-db3b4472625a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.675970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99431f1-fb30-4148-9930-db3b4472625a None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.677253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99431f1-fb30-4148-9930-db3b4472625a None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:08.678973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99431f1-fb30-4148-9930-db3b4472625a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:08.683322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 113/223] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:08.684749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.685193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.686251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.710851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:08.712173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:08.748796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a567-6f95-4450-b28c-eb2780bd8b44 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.790947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.791853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.792223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.792573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.792796 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 114/224] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:08.793535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:08.794004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.794125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:08.795684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:08.807668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 111/225] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:08.814402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.919280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2b669-c05d-495b-b53f-6ee1ff15bc6e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.939460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d97f6-1f77-4ad9-b84e-84ed3621f421 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:08.960685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.961557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:08.962114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:08.962597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:08.963701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=796e8a95c8ee4773a5f3e450fc2a3dbd) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:08.964204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:08.965865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:08.972065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 115/226] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/role_assignments?user.id=796e8a95c8ee4773a5f3e450fc2a3dbd&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:08.973209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:08.998417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:08.999808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.000342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.000811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] PATH_INFO: `/v3/users/15f4f3f309ae4dddace4d43c83d915af` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.002644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] RBAC: Authorizing `identity:get_user(user_id=15f4f3f309ae4dddace4d43c83d915af)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:09.006184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:09.010658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 112/227] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/users/15f4f3f309ae4dddace4d43c83d915af => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:09.015894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:09.179915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aa7e4-17fa-4ad3-ab56-704388035771 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:09.220707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02ce5d-bf7c-46dd-b64c-6681a0ad7714 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:09.253737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:09.254562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.254847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.255125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.275672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:09.284522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:09.285436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:09.286215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 116/228] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:09.291030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:09.291935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.292217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.292782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.294012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:09.295634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:09.298493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 113/229] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:09 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:09.298792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:09.303030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:09.435121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed472022-e5ec-4e47-b56f-60afde62ab15 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:09.478418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158593f-5ff6-4b4c-a638-889b7369a044 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:09.497074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:09.497752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.498590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.504426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.505231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:09.505550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:09.506969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:09.528957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 117/230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:09.545484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:09.554587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:09.555516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.555799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.556070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960/users/15f4f3f309ae4dddace4d43c83d915af/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.558048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] RBAC: Authorizing `identity:create_grant(project_id=737352b3ae13476fb229cde50784b960, user_id=15f4f3f309ae4dddace4d43c83d915af, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:09.559527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:09.653365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f72ee-e909-47d9-8e29-af8f4d80d949 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:09.660531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 114/231] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:09 2022] PUT /identity/v3/projects/737352b3ae13476fb229cde50784b960/users/15f4f3f309ae4dddace4d43c83d915af/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:08:09.698898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:09.699737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.700021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.700298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] PATH_INFO: `/v3/users/15f4f3f309ae4dddace4d43c83d915af` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.701556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] RBAC: Authorizing `identity:get_user(user_id=15f4f3f309ae4dddace4d43c83d915af)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:09.703115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:09.704988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 118/232] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:09 2022] GET /identity/v3/users/15f4f3f309ae4dddace4d43c83d915af => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:09.710579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:09.835025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d5df7-3ef3-4243-8fb7-dec5a978a1cc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:09.872497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa26d2f-01af-4784-a650-db43a69ce60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:09.873416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa26d2f-01af-4784-a650-db43a69ce60c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:09.873695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa26d2f-01af-4784-a650-db43a69ce60c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:09.873971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa26d2f-01af-4784-a650-db43a69ce60c None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:09.875588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa26d2f-01af-4784-a650-db43a69ce60c None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:09.876986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa26d2f-01af-4784-a650-db43a69ce60c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:09.879012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 115/233] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:09 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:09.885024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:10.017561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9390f94-49cd-4e69-91c7-aacb04d337fe None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:10.053600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e399-c1d4-4ae7-842a-0530e23082f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:10.054555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e399-c1d4-4ae7-842a-0530e23082f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:10.054844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e399-c1d4-4ae7-842a-0530e23082f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:10.055124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e399-c1d4-4ae7-842a-0530e23082f4 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960/users/15f4f3f309ae4dddace4d43c83d915af/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:10.057404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822e399-c1d4-4ae7-842a-0530e23082f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=737352b3ae13476fb229cde50784b960, user_id=15f4f3f309ae4dddace4d43c83d915af, role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:10.058857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822e399-c1d4-4ae7-842a-0530e23082f4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:10.183186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 119/234] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:09 2022] PUT /identity/v3/projects/737352b3ae13476fb229cde50784b960/users/15f4f3f309ae4dddace4d43c83d915af/roles/aa3a7655caa4456091096e448052a63b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:10.843985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b9db2-53a5-4a65-a804-9b71138aa4da None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:10.843985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b9db2-53a5-4a65-a804-9b71138aa4da None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:10.843985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b9db2-53a5-4a65-a804-9b71138aa4da None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:10.843985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 116/235] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:10.852631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:10.852631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:10.852631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:10.877277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:10.878821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:10.972423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 120/236] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:11.009256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b9db2-53a5-4a65-a804-9b71138aa4da None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:11.152017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b9db2-53a5-4a65-a804-9b71138aa4da None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:11.200327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959e2ed-c236-4b4c-bd53-f98d852624e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:11.202075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959e2ed-c236-4b4c-bd53-f98d852624e9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.202563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959e2ed-c236-4b4c-bd53-f98d852624e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.203058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959e2ed-c236-4b4c-bd53-f98d852624e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.220307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959e2ed-c236-4b4c-bd53-f98d852624e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-9959e2ed-c236-4b4c-bd53-f98d852624e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:11.230021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:11.230925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:11.231772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:11.233073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 117/237] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:11.237954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:11.290766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8afd-419c-4ada-84d2-441282fb7d0b None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.291189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8afd-419c-4ada-84d2-441282fb7d0b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.291388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8afd-419c-4ada-84d2-441282fb7d0b None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.292726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 118/238] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:11.308624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.308918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.309188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.340377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:11.341608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:11.367110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace76d-333f-4eaf-95d8-dafae405be7a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:11.409478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:11.410527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.411027 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.411535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.412624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:11.413982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:11.415703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:11.426427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 121/239] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:11.436802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:11.469732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 119/240] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:11.500132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:11.613935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520f8f-966e-4209-be4b-8153f7f60866 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:11.650667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166a809-2662-4dd2-821e-3963f996e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:11.651602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a809-2662-4dd2-821e-3963f996e09e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.651886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a809-2662-4dd2-821e-3963f996e09e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.652162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a809-2662-4dd2-821e-3963f996e09e None admin] PATH_INFO: `/v3/users/98411e7f9ec8422fb902332c73f1be39` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.652574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f9f6c-b516-4f2b-816e-741fed6ae373 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:11.666851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166a809-2662-4dd2-821e-3963f996e09e None admin] RBAC: Authorizing `identity:get_user(user_id=98411e7f9ec8422fb902332c73f1be39)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:11.668305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166a809-2662-4dd2-821e-3963f996e09e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:11.671298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 122/241] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:11 2022] GET /identity/v3/users/98411e7f9ec8422fb902332c73f1be39 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:11.671694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1010-0832-46c0-9f15-e2efb2d26d4d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.672058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1010-0832-46c0-9f15-e2efb2d26d4d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.672339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1010-0832-46c0-9f15-e2efb2d26d4d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.673777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 123/242] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:11.678628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc1010-0832-46c0-9f15-e2efb2d26d4d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:11.701984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e0167-5af6-4131-a6b0-c8d75174aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:11.703115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0167-5af6-4131-a6b0-c8d75174aa0d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.703847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0167-5af6-4131-a6b0-c8d75174aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.704248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0167-5af6-4131-a6b0-c8d75174aa0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.705863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e0167-5af6-4131-a6b0-c8d75174aa0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:11.707992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e0167-5af6-4131-a6b0-c8d75174aa0d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:11.710376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 120/243] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:11.711743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.712029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.712303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.731498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:11.732882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:11.804909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc1010-0832-46c0-9f15-e2efb2d26d4d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:11.808704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 121/244] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:11.814387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:11.857289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:11.857973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.858255 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.858530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.924691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff7ff-c3c0-4d28-b790-cba10a01bd67 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:11.928865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:11.930047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:11.960340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:11.961175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:11.961562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:11.961944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:11.962759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:11.964387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:12.033992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 124/245] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:12.035511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.049090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 122/246] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:11 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:12.050515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.168369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e885-7afc-42c5-8a08-942c1faa76c5 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.206444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.207182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.207511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.207786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.220229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:12.228517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:12.229482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:12.230271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 125/247] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:12.237364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.294215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de44d2-76d6-47a0-9b54-a3723df3b979 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.332328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.333235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.333518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.333794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.335001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:12.336517 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:12.338444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 123/248] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:12.344137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.345390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f989-211d-4e17-8ac4-61d15432e12f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.381101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.381782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.382066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.382340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.383085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:12.383421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:12.384819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:12.395100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 126/249] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:12.401468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.458449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58848-7bfd-488c-b727-bedf442abbc5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.498097 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.498829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.499118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.501871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.501871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] RBAC: Adding query filter params (role.id=1e187930497e4bd3af06094b1540c1db, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=98411e7f9ec8422fb902332c73f1be39) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:12.501871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:12.502132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f68291-9edd-412c-a142-66cc4a8d4b1a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:12.513066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 124/250] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/role_assignments?user.id=98411e7f9ec8422fb902332c73f1be39&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=1e187930497e4bd3af06094b1540c1db => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:12.515380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efdfd-987e-4b5f-a6be-fea10d6216c9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.516386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efdfd-987e-4b5f-a6be-fea10d6216c9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.516386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efdfd-987e-4b5f-a6be-fea10d6216c9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.517623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 125/251] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:12.524124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.524424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.524697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.534734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ef337-ed05-4084-ab6f-b3b4cf3c04ff None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.548294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:12.549525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:12.590636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.592119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.592400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.592677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] PATH_INFO: `/v3/users/796e8a95c8ee4773a5f3e450fc2a3dbd` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.594064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] RBAC: Authorizing `identity:get_user(user_id=796e8a95c8ee4773a5f3e450fc2a3dbd)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:12.595892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:12.597330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 127/252] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/users/796e8a95c8ee4773a5f3e450fc2a3dbd => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:12.603207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.654405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 126/253] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:12.684425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.748601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed753f92-9e12-47f2-8681-fe8e282df92f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.799362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.800237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.800518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.800814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.802978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:12.804459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:12.806563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 128/254] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:12.817457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.828220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e07c7-ef07-41aa-b8e8-0b68c02b03fa None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:12.886701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:12.887585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:12.887866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:12.888140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:12.899965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:12.908770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:12.909706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:12.910493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 127/255] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:12.915996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:12.991314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da878f-9450-40a5-ad0d-0d61cf4f8343 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.020426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d23f-c518-4c5c-a92f-66d2230a1c74 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.048622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc4d72-5025-4e4a-9336-1258ca76fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.049538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4d72-5025-4e4a-9336-1258ca76fe96 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.049826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4d72-5025-4e4a-9336-1258ca76fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.050103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4d72-5025-4e4a-9336-1258ca76fe96 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960/users/796e8a95c8ee4773a5f3e450fc2a3dbd/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.054997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.055748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.056017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.056305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.056688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc4d72-5025-4e4a-9336-1258ca76fe96 None admin] RBAC: Authorizing `identity:create_grant(project_id=737352b3ae13476fb229cde50784b960, user_id=796e8a95c8ee4773a5f3e450fc2a3dbd, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:13.057115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:13.057430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:13.058188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc4d72-5025-4e4a-9336-1258ca76fe96 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:13.058820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ca209-620a-4d84-b7a0-cac846161e1f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:13.070802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 128/256] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:13.072314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2b5b-9125-423e-802b-73a7e9c21c36 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.072614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2b5b-9125-423e-802b-73a7e9c21c36 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.072900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2b5b-9125-423e-802b-73a7e9c21c36 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.074463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 129/257] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:13.075161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2b5b-9125-423e-802b-73a7e9c21c36 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:13.182187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 129/258] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:12 2022] PUT /identity/v3/projects/737352b3ae13476fb229cde50784b960/users/796e8a95c8ee4773a5f3e450fc2a3dbd/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:13.183523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.183816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.184094 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.191747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2b5b-9125-423e-802b-73a7e9c21c36 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.228328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:13.229473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:13.231456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.232949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.233289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.233614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] PATH_INFO: `/v3/users/15f4f3f309ae4dddace4d43c83d915af` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.235097 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] RBAC: Authorizing `identity:get_user(user_id=15f4f3f309ae4dddace4d43c83d915af)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:13.238279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:13.240287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 130/259] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:13 2022] GET /identity/v3/users/15f4f3f309ae4dddace4d43c83d915af => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:13.246848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:13.365577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c042d5-9128-4a96-863e-0c5b903be003 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.405681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.406412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.406980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.413600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 130/260] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:13.450216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:13.489345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:13.490942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:13.620465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 131/261] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:13.626470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:13.729406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2a1b-d50a-4e74-b39b-b4a25130206a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.737722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094503-521b-4d9b-bd71-fdba5e6afe72 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.775168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.776504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.776792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.777072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.778279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:13.781270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:13.787918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 132/262] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:13 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:13.789867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:13.828015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.828840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.829123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.829399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.850431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:13.866936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:13.869177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:13.871213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 131/263] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:13.879368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:13.897417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad35ad-4afd-445f-9e77-3791f622052e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:13.935527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:13.936210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:13.936491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:13.936763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:13.937829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=15f4f3f309ae4dddace4d43c83d915af) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:13.938146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:13.939659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:13.945905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 133/264] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:13 2022] GET /identity/v3/role_assignments?user.id=15f4f3f309ae4dddace4d43c83d915af&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:14.048654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528af9a-5240-4079-81c1-a3aeeda56119 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:14.085847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:14.086532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:14.086813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:14.087097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:14.087911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:14.088223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:14.089670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:14.099755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 132/265] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:14.105498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:14.213518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547d81-ff93-4bab-9509-60319e28e78d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:14.251099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:14.252022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:14.252307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:14.252585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] PATH_INFO: `/v3/users/15f4f3f309ae4dddace4d43c83d915af` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:14.253883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] RBAC: Authorizing `identity:get_user(user_id=15f4f3f309ae4dddace4d43c83d915af)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:14.255383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:14.257314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 134/266] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:14 2022] GET /identity/v3/users/15f4f3f309ae4dddace4d43c83d915af => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:14.262866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:14.371287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30999-c064-4bfd-bd31-a2bc5c8016e4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:14.406772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:14.407458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:14.407787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:14.408074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:14.484004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:14.485418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:14.587073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 133/267] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:14.592501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:14.704791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483514f-86f9-4828-9335-90b919d57d40 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:14.750302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab6c7c-6bc6-4cb1-8868-dd814d045901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:14.751120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6c7c-6bc6-4cb1-8868-dd814d045901 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:14.751429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6c7c-6bc6-4cb1-8868-dd814d045901 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:14.751705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6c7c-6bc6-4cb1-8868-dd814d045901 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:14.755980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab6c7c-6bc6-4cb1-8868-dd814d045901 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:14.757469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab6c7c-6bc6-4cb1-8868-dd814d045901 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:14.759231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 135/268] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:14 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:14.765501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:14.872018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dfc8-7b1c-4f96-b5f6-d1ed35985056 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:14.907770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:14.908435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:14.908719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:14.908996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:14.909830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] RBAC: Adding query filter params (role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=15f4f3f309ae4dddace4d43c83d915af) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:14.910141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:14.911636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ff99e-cc8c-40b6-b362-30543786fbcd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:14.918043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 134/269] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:14 2022] GET /identity/v3/role_assignments?user.id=15f4f3f309ae4dddace4d43c83d915af&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=aa3a7655caa4456091096e448052a63b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:15.202228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43beb8c-c92e-41e5-8c53-c2b96eeba8dd None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.203214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43beb8c-c92e-41e5-8c53-c2b96eeba8dd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.203835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43beb8c-c92e-41e5-8c53-c2b96eeba8dd None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.205435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 136/270] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:15.211102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.212054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.212345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.229977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:15.231171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:15.303130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 135/271] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:15.327569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43beb8c-c92e-41e5-8c53-c2b96eeba8dd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:15.442896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43beb8c-c92e-41e5-8c53-c2b96eeba8dd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:15.483336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:15.484078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.484637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.495231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:15.517210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:15.518098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:15.519089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 137/272] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:15.524820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:15.665438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f489-3bde-4504-bd71-b1d8c4f7037e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:15.703926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:15.704601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.704882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.705440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.706196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:15.706498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:15.708687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216c761-659d-4a3f-803f-40ff8249d05f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:15.722125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 136/273] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:15.727238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:15.760290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ab625-107c-484c-8bdb-e4c4a4f61de3 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.760567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ab625-107c-484c-8bdb-e4c4a4f61de3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.760765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ab625-107c-484c-8bdb-e4c4a4f61de3 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.762483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 137/274] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:15.764194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8ef2-ab8c-4cea-9a1b-d54ad3addaa2 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.764513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8ef2-ab8c-4cea-9a1b-d54ad3addaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.764795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd8ef2-ab8c-4cea-9a1b-d54ad3addaa2 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.766313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 138/275] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:15.770026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e93fc-3629-4932-8653-4c49e1ccdf49 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.770422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e93fc-3629-4932-8653-4c49e1ccdf49 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.771156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e93fc-3629-4932-8653-4c49e1ccdf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.787695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-875e93fc-3629-4932-8653-4c49e1ccdf49 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:15.789144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-875e93fc-3629-4932-8653-4c49e1ccdf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:15.848553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6d3f6-ef69-499a-b96c-0ee72307dffb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:15.861359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 139/276] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:15.865463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e668-ec12-4ab2-897f-179975271dac None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.866693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e668-ec12-4ab2-897f-179975271dac None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.867756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e668-ec12-4ab2-897f-179975271dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.888761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:15.889637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:15.890036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:15.890226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] PATH_INFO: `/v3/users/98411e7f9ec8422fb902332c73f1be39` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:15.891428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] RBAC: Authorizing `identity:get_user(user_id=98411e7f9ec8422fb902332c73f1be39)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:15.892896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:15.894483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7687e668-ec12-4ab2-897f-179975271dac None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:15.895674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7687e668-ec12-4ab2-897f-179975271dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:15.898299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 138/277] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:15 2022] GET /identity/v3/users/98411e7f9ec8422fb902332c73f1be39 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:15.900368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:15.973550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 140/278] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:15.974426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e668-ec12-4ab2-897f-179975271dac None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.032307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cde75-86a2-4f4f-aa85-89b0028251f6 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.077847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.078642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.078985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.079342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.080553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.082024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.083738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 139/279] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:16.084067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e668-ec12-4ab2-897f-179975271dac None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.084581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.124678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.125573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.125859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.126134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.127337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.128817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.130564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 141/280] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:15 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:16.131332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.219747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933b49-79f3-4525-814e-efa32ee931ba None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.239949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358902d-169d-4da9-a6e7-c3092e7d01dd None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.259599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.261090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.261789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.262239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.273700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.274079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:16.274370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.274654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.274926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.275775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.277217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:16.281846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:16.282739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:16.284080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 140/281] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:16.285284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.366034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 142/282] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:16 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:16.366871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.396795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d7f5e-8328-45e3-81ec-4573e16df749 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.437945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8a36a-26d5-456c-b0ef-15281f4a6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.439004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8a36a-26d5-456c-b0ef-15281f4a6fb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.439323 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8a36a-26d5-456c-b0ef-15281f4a6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.439610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8a36a-26d5-456c-b0ef-15281f4a6fb5 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960/users/98411e7f9ec8422fb902332c73f1be39/roles/1e187930497e4bd3af06094b1540c1db` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.442455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8a36a-26d5-456c-b0ef-15281f4a6fb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=737352b3ae13476fb229cde50784b960, user_id=98411e7f9ec8422fb902332c73f1be39, role_id=1e187930497e4bd3af06094b1540c1db)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.444063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8a36a-26d5-456c-b0ef-15281f4a6fb5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.491658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d162bb9-0706-4aa7-8aa9-c0bfb4602ce4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.539690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.540294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.540579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.540858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.541623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:16.541934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.543607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.553262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 143/283] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:16.559401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.590023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 141/284] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:16 2022] PUT /identity/v3/projects/737352b3ae13476fb229cde50784b960/users/98411e7f9ec8422fb902332c73f1be39/roles/1e187930497e4bd3af06094b1540c1db => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:16.637910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048745e8-2d52-4485-97f3-23d1646be0f1 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.638817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048745e8-2d52-4485-97f3-23d1646be0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.639103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048745e8-2d52-4485-97f3-23d1646be0f1 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.640835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 142/285] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:16.646557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.646846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.647129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.666140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:16.667381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:16.681740 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9991d-402c-4e24-baaf-f5a1f19d77b2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.722163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.723128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.723588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.723863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] PATH_INFO: `/v3/users/a0d5fd80bac343a6a6dd2a93cd3c775a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.745229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] RBAC: Authorizing `identity:get_user(user_id=a0d5fd80bac343a6a6dd2a93cd3c775a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.747332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.751029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 144/286] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:16 2022] GET /identity/v3/users/a0d5fd80bac343a6a6dd2a93cd3c775a => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:16.753296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 143/287] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:16.759952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.778778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:16.884267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719b13-bf77-4146-8491-b26986637d39 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.896533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8ed50-2423-4b8f-8a60-d26b3741822d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:16.928149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.928916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.929198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.929481 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.930299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, user.id=a0d5fd80bac343a6a6dd2a93cd3c775a, scope.system=all) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:16.930608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:16.932271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:16.933313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:16.934378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:16.934891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:16.935426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:16.937863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 145/288] 10.222.0.42 () {56 vars in 1308 bytes} [Tue May 3 16:08:16 2022] GET /identity/v3/role_assignments?user.id=a0d5fd80bac343a6a6dd2a93cd3c775a&scope.system=all&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:16.948494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:16.958185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:16.959140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:16.959973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:16.962901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 144/289] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:16.969680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:17.109263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720d864-c786-47ff-aaf1-b1c0249a2621 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:17.143849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:17.144697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:17.144976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:17.145248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:17.145998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:17.146298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:17.147730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:17.157395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 146/290] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:17.162661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:17.281220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19e23-a9a1-4c73-a09f-408555ba6b32 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:17.316104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:17.317298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:17.317804 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:17.318304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] PATH_INFO: `/v3/users/796e8a95c8ee4773a5f3e450fc2a3dbd` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:17.319745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] RBAC: Authorizing `identity:get_user(user_id=796e8a95c8ee4773a5f3e450fc2a3dbd)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:17.321549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:17.323847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 145/291] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:17 2022] GET /identity/v3/users/796e8a95c8ee4773a5f3e450fc2a3dbd => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:17.329995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:17.445891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b7ed-03c9-47f5-98ec-99ff3dbe25ea None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:17.486722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:17.487405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:17.487693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:17.487967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:17.557788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:17.559264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:17.671676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:17.677308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:17.813589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a4145-738d-4359-bf44-e1dc4272aa68 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:17.854980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7db15-7d97-4f57-a694-490971b8b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:17.856248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7db15-7d97-4f57-a694-490971b8b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:17.857306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7db15-7d97-4f57-a694-490971b8b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:17.857794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7db15-7d97-4f57-a694-490971b8b0e7 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:17.859200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7db15-7d97-4f57-a694-490971b8b0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:17.860872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7db15-7d97-4f57-a694-490971b8b0e7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:17.862773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 146/293] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:17 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:17.872410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:17.993655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56691416-ab1a-4f9a-8f49-cbd50cacab40 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:18.036860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:18.037533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:18.037810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:18.038082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:18.038912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=796e8a95c8ee4773a5f3e450fc2a3dbd) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:18.039218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:18.040669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d137534-b2ec-422b-a9b2-c92a4da3b20c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:18.047041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 148/294] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:17 2022] GET /identity/v3/role_assignments?user.id=796e8a95c8ee4773a5f3e450fc2a3dbd&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:19.188611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee13d5-fb2a-420b-8cc1-42f49b708aea None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.189686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee13d5-fb2a-420b-8cc1-42f49b708aea None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.190179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee13d5-fb2a-420b-8cc1-42f49b708aea None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.192248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 147/295] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:19.198376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399293c-f02a-490f-a372-14380045cb36 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.199396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399293c-f02a-490f-a372-14380045cb36 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.199923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399293c-f02a-490f-a372-14380045cb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.219212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2399293c-f02a-490f-a372-14380045cb36 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:19.220820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2399293c-f02a-490f-a372-14380045cb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:19.227075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7d8a-b06a-4103-ab89-d97f93b80e0f None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.227403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7d8a-b06a-4103-ab89-d97f93b80e0f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.227686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7d8a-b06a-4103-ab89-d97f93b80e0f None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.229044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 148/296] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:19.234404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.234692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.234972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.251513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:19.252688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:19.304552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 149/297] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:19.327469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 149/298] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:19.328775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399293c-f02a-490f-a372-14380045cb36 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.350229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.437541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399293c-f02a-490f-a372-14380045cb36 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:19.456516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabab3-c263-4c13-912a-bdbc07980950 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:19.470629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa79a4-3fbd-4806-8cc7-7f5fc61b8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:19.471478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa79a4-3fbd-4806-8cc7-7f5fc61b8c0e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.471763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa79a4-3fbd-4806-8cc7-7f5fc61b8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.472032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa79a4-3fbd-4806-8cc7-7f5fc61b8c0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.482502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa79a4-3fbd-4806-8cc7-7f5fc61b8c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:19.490057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22835b5-0ffe-42dd-af9c-9d3ceaac4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-f5fa79a4-3fbd-4806-8cc7-7f5fc61b8c0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:19.490289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:19.491162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:19.492058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:19.492738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22835b5-0ffe-42dd-af9c-9d3ceaac4be4 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.492738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22835b5-0ffe-42dd-af9c-9d3ceaac4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.492738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22835b5-0ffe-42dd-af9c-9d3ceaac4be4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.492920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 150/299] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:19.492920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48d13-4c1c-4063-be57-40ef23ef91db None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.492920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48d13-4c1c-4063-be57-40ef23ef91db None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.493605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48d13-4c1c-4063-be57-40ef23ef91db None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.494574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 151/300] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:19.496938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22835b5-0ffe-42dd-af9c-9d3ceaac4be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:19.499049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22835b5-0ffe-42dd-af9c-9d3ceaac4be4 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:19.505159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48d13-4c1c-4063-be57-40ef23ef91db None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.505310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 150/301] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:19.505310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.505310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.505310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.522155 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:19.523379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:19.588610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 151/302] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:19.599460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.617744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48d13-4c1c-4063-be57-40ef23ef91db None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:19.650323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:19.650982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.651299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.651564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.652298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:19.652600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:19.654257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf4ff-ceec-493e-a7a2-7f0295bcb228 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:19.662438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 152/303] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:19.663664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44d24-8312-4c0d-bc9f-c08b77e6b1c5 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.663948 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44d24-8312-4c0d-bc9f-c08b77e6b1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.664222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e44d24-8312-4c0d-bc9f-c08b77e6b1c5 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.665435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 153/304] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:19.666122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44d24-8312-4c0d-bc9f-c08b77e6b1c5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.688537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc204f79-34c3-4ebd-a4be-a1262e73259e None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:19.722079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:19.722666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.722948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.723219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] PATH_INFO: `/v3/groups` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.723919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:19.725342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:19.769325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e44d24-8312-4c0d-bc9f-c08b77e6b1c5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:19.798329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 152/305] 10.222.0.42 () {60 vars in 1134 bytes} [Tue May 3 16:08:19 2022] POST /identity/v3/groups => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:19.799390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.802079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6cfdd-21c4-436a-b7fc-4da040a67794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:19.802913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6cfdd-21c4-436a-b7fc-4da040a67794 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.803191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6cfdd-21c4-436a-b7fc-4da040a67794 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.803494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6cfdd-21c4-436a-b7fc-4da040a67794 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.815142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6cfdd-21c4-436a-b7fc-4da040a67794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-56b6cfdd-21c4-436a-b7fc-4da040a67794 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:19.823042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:19.824162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:19.824963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 154/306] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:19.828877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.829171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.831153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.849302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:19.855417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:19.919388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74693840-cd0c-42d0-8651-733824c12d22 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:19.927973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 155/307] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:19.935624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:19.958285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:19.959186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:19.959487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:19.959764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] PATH_INFO: `/v3/users/98411e7f9ec8422fb902332c73f1be39` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:19.961033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] RBAC: Authorizing `identity:get_user(user_id=98411e7f9ec8422fb902332c73f1be39)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:19.962522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:19.964242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 153/308] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/users/98411e7f9ec8422fb902332c73f1be39 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:19.965011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.045499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04e730-c275-4366-ac2e-20697d3f7ccc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.071880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268afef-84e3-4339-92d3-40318ce4e4d1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.081785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.082468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.083069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.083385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.084417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:20.084723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.086614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.096029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 156/309] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.096908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.111605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.112401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.112691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.112974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.124309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:20.132074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:20.133156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:20.134173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 154/310] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:20.134933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.202603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f388b32-acdf-40ee-a5d2-a3b19d5a66a1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.234140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b488a7-eebf-4096-9964-3fdd56728074 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.235430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.236084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.236369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.236654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.271449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.272723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.273257 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.273734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] PATH_INFO: `/v3/users/025c1446528f488d90bac20b63fc6b9e` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.289588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] RBAC: Authorizing `identity:get_user(user_id=025c1446528f488d90bac20b63fc6b9e)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.292036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.300207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 155/311] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/users/025c1446528f488d90bac20b63fc6b9e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.301295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.303568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.305029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.402984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f01d0-4301-4398-b194-470fbd2fcc5d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.406475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 157/312] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:20.407487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.438609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.439298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.439585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.439862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.440604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:20.440911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.442278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.455357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 156/313] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.455357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.507696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da335-04c2-4efa-bbaf-098e8121260f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.547608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.548422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.548765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.549357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.550538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] RBAC: Adding query filter params (role.id=1e187930497e4bd3af06094b1540c1db, user.id=025c1446528f488d90bac20b63fc6b9e, scope.system=all) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:20.550802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.552435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.567509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 158/314] 10.222.0.42 () {56 vars in 1308 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/role_assignments?user.id=025c1446528f488d90bac20b63fc6b9e&scope.system=all&role.id=1e187930497e4bd3af06094b1540c1db => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.567714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86d0e4-bc5f-49a9-bcbc-027a4fd19da1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.567809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.604390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.605296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.605584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.605866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.607235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.608770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.610610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 157/315] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.617044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.681961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568d391-2925-45de-85a1-1a97bb92398f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.721121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.722330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.722896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.723367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] PATH_INFO: `/v3/users/a0d5fd80bac343a6a6dd2a93cd3c775a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.724968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] RBAC: Authorizing `identity:get_user(user_id=a0d5fd80bac343a6a6dd2a93cd3c775a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.726653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.733787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 159/316] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/users/a0d5fd80bac343a6a6dd2a93cd3c775a => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.735037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:20.759396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b815a-4171-4c0f-ba34-3cf47a0dd520 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.811363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.812629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.813123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.813672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.814925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] RBAC: Adding query filter params (role.id=1e187930497e4bd3af06094b1540c1db, scope.project.id=737352b3ae13476fb229cde50784b960, user.id=98411e7f9ec8422fb902332c73f1be39) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:20.815937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.818068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c09d-814e-49fb-8a00-fab9327cb639 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:20.831282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 158/317] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:20 2022] GET /identity/v3/role_assignments?user.id=98411e7f9ec8422fb902332c73f1be39&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=1e187930497e4bd3af06094b1540c1db => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:20.856978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9289004-f0f6-4010-85bc-9afaaedd23fa None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:20.895194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96280860-6ef7-4ce3-812e-b7250bc490a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:20.896126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96280860-6ef7-4ce3-812e-b7250bc490a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:20.896410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96280860-6ef7-4ce3-812e-b7250bc490a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:20.896686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96280860-6ef7-4ce3-812e-b7250bc490a5 None admin] PATH_INFO: `/v3/system/users/a0d5fd80bac343a6a6dd2a93cd3c775a/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:20.898282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96280860-6ef7-4ce3-812e-b7250bc490a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0d5fd80bac343a6a6dd2a93cd3c775a, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:20.899746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96280860-6ef7-4ce3-812e-b7250bc490a5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:21.058889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 160/318] 10.222.0.42 () {58 vars in 1334 bytes} [Tue May 3 16:08:20 2022] PUT /identity/v3/system/users/a0d5fd80bac343a6a6dd2a93cd3c775a/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:22.101889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a318d-156a-4d71-9432-3f4d2a888c1d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:22.102461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a318d-156a-4d71-9432-3f4d2a888c1d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:22.102461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a318d-156a-4d71-9432-3f4d2a888c1d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:22.103964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 159/319] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:22.108873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:22.109298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:22.109495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:22.126058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:22.127223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:22.195080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 161/320] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:22.217209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a318d-156a-4d71-9432-3f4d2a888c1d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:22.322244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a318d-156a-4d71-9432-3f4d2a888c1d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:22.354571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dbb5a-c23b-4964-8d17-34e03f6b1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:22.355306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dbb5a-c23b-4964-8d17-34e03f6b1c2f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:22.355587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dbb5a-c23b-4964-8d17-34e03f6b1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:22.355857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dbb5a-c23b-4964-8d17-34e03f6b1c2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:22.357660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dbb5a-c23b-4964-8d17-34e03f6b1c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:22.359175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dbb5a-c23b-4964-8d17-34e03f6b1c2f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:22.360975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 160/321] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:22.366195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:22.460802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c8f8-843c-445d-8783-c6adea68375c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:22.534801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc5d9-c03e-434d-9319-95300fda2a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:22.535493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc5d9-c03e-434d-9319-95300fda2a34 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:22.535771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc5d9-c03e-434d-9319-95300fda2a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:22.536038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc5d9-c03e-434d-9319-95300fda2a34 None admin] PATH_INFO: `/v3/groups` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:22.536726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bc5d9-c03e-434d-9319-95300fda2a34 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:22.538146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bc5d9-c03e-434d-9319-95300fda2a34 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:22.652483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 162/322] 10.222.0.42 () {60 vars in 1134 bytes} [Tue May 3 16:08:22 2022] POST /identity/v3/groups => generated 226 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:22.867378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ad7fb-a43b-4762-be99-f5fc630425d5 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:22.867689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ad7fb-a43b-4762-be99-f5fc630425d5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:22.867943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ad7fb-a43b-4762-be99-f5fc630425d5 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:22.869306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 161/323] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:22.875068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:22.875387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:22.875660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:22.892908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:22.894346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:22.965291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 163/324] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:22.988194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ad7fb-a43b-4762-be99-f5fc630425d5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:23.098748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ad7fb-a43b-4762-be99-f5fc630425d5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:23.135556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897604-e757-49b9-90f9-f9823b615187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:23.137136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897604-e757-49b9-90f9-f9823b615187 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.137572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897604-e757-49b9-90f9-f9823b615187 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.138751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897604-e757-49b9-90f9-f9823b615187 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.151760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897604-e757-49b9-90f9-f9823b615187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-f4897604-e757-49b9-90f9-f9823b615187 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:23.160162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:23.161308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:23.162283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:23.164293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 162/325] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:23.170550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:23.288212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b81e0-282c-42c4-bfaf-5e4ca79da14c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:23.330435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:23.331103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.331449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.331723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.332476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:23.332776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:23.334141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:23.334715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff6911-36f0-4b9a-8726-27dcd000dbcd None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.335087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff6911-36f0-4b9a-8726-27dcd000dbcd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.335473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff6911-36f0-4b9a-8726-27dcd000dbcd None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.337072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 163/326] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:23.343739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.343739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.343739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.348282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 164/327] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:23.354234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:23.371900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:23.375037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:23.466414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 164/328] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:23.477299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fac76-9098-4b43-9093-68f8703a52e0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:23.497973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:23.520536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:23.521743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.522218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.522699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] PATH_INFO: `/v3/users/025c1446528f488d90bac20b63fc6b9e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.524188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] RBAC: Authorizing `identity:get_user(user_id=025c1446528f488d90bac20b63fc6b9e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:23.525889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:23.528078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 165/329] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:23 2022] GET /identity/v3/users/025c1446528f488d90bac20b63fc6b9e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:23.533430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:23.624958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16128ec8-90cd-4f66-900c-6c7343ac5db7 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:23.658267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fb41-70c6-4e3f-942f-ac6ec712b39d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:23.661955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:23.662189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.662471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.662807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.674788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:23.683392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:23.684374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:23.685914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 165/330] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:23.691166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:23.701718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:23.702693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.702988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.703283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] PATH_INFO: `/v3/system/users/025c1446528f488d90bac20b63fc6b9e/roles/1e187930497e4bd3af06094b1540c1db` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.705848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=025c1446528f488d90bac20b63fc6b9e, role_id=1e187930497e4bd3af06094b1540c1db)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:23.707240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:23.778697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 166/331] 10.222.0.42 () {58 vars in 1334 bytes} [Tue May 3 16:08:23 2022] PUT /identity/v3/system/users/025c1446528f488d90bac20b63fc6b9e/roles/1e187930497e4bd3af06094b1540c1db => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:08:23.805114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c692c8-bfde-4f9c-8d80-57a2d2548a70 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:23.845207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:23.846289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:23.846770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:23.847286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:23.848274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:23.848789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:23.850436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:23.866004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 166/332] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:23.873156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:24.015103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ac99a-f3eb-4a1d-bdc2-736ee59fbe9d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:24.056440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2db4e1-683d-42dc-a8a9-177203cdc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:24.057321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db4e1-683d-42dc-a8a9-177203cdc210 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:24.057605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db4e1-683d-42dc-a8a9-177203cdc210 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:24.057882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2db4e1-683d-42dc-a8a9-177203cdc210 None admin] PATH_INFO: `/v3/users/a0d5fd80bac343a6a6dd2a93cd3c775a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:24.064101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db4e1-683d-42dc-a8a9-177203cdc210 None admin] RBAC: Authorizing `identity:get_user(user_id=a0d5fd80bac343a6a6dd2a93cd3c775a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:24.065579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2db4e1-683d-42dc-a8a9-177203cdc210 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:24.067639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 167/333] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:23 2022] GET /identity/v3/users/a0d5fd80bac343a6a6dd2a93cd3c775a => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:24.073120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:24.192115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e95ec7-c6df-4e2d-8bc1-75cddf9ed4e8 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:24.227599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:24.228267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:24.228558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:24.228838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:24.229679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] RBAC: Adding query filter params (role.id=a39aa06b3d53485e8b99f7660fba1306, user.id=a0d5fd80bac343a6a6dd2a93cd3c775a, scope.system=all) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:24.230000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:24.231512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e3c68-8c0e-4388-b728-39f208288b60 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:24.244405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 167/334] 10.222.0.42 () {56 vars in 1308 bytes} [Tue May 3 16:08:24 2022] GET /identity/v3/role_assignments?user.id=a0d5fd80bac343a6a6dd2a93cd3c775a&scope.system=all&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:25.820431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d892-44bd-4acc-8aaa-03e79d7cd387 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:25.821176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d892-44bd-4acc-8aaa-03e79d7cd387 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:25.821176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d892-44bd-4acc-8aaa-03e79d7cd387 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:25.822584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 168/335] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:25.829066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:25.829698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:25.829698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:25.852408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:25.853657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:25.937508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 168/336] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:25.972302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d892-44bd-4acc-8aaa-03e79d7cd387 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:26.085028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d892-44bd-4acc-8aaa-03e79d7cd387 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:26.122405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:26.123632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.124124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.124593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.139235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:26.147667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:26.148579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:26.149390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:26.151774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 169/337] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:26.160369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:26.284526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cada29-44bc-464c-bb66-49c42b22c9f8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:26.331231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:26.331964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.332250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.332534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.333298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:26.333603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:26.335020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5717e8d-b32a-4bfc-bd8e-61d300fd26b1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:26.344197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 169/338] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:26.349759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:26.370079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039da2-bf5c-4507-bc35-ec33c976c090 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.370412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039da2-bf5c-4507-bc35-ec33c976c090 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.370661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039da2-bf5c-4507-bc35-ec33c976c090 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.372870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 170/339] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:26.379169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78b144-e605-49b8-8085-3d8d7d92624e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.379647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78b144-e605-49b8-8085-3d8d7d92624e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.379933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78b144-e605-49b8-8085-3d8d7d92624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.418370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-4c78b144-e605-49b8-8085-3d8d7d92624e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:26.420174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4c78b144-e605-49b8-8085-3d8d7d92624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:26.536637 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf65dc-7f8a-41a5-8c2a-19b02e849840 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:26.573430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 171/340] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:26.575732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527da54-a906-428f-ae08-a3d8431b0e6e None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.576218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527da54-a906-428f-ae08-a3d8431b0e6e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.576699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527da54-a906-428f-ae08-a3d8431b0e6e None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.578392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 172/341] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:26.583723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:26.584146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.584392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.584681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.585019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.585250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.585733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.612081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:26.613362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:26.682576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:26.684301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:26.707760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 173/342] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:26.708914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:26.823050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1ab5-aa29-4915-b120-8c30e7a0e021 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:26.867907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 170/343] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:26.868721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:26.869550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:26.869835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:26.870095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:26.870204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:26.888839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:26.906093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:26.907238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 174/344] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:26.908271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:26.984074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1ed05-6169-4548-9e33-30a6a9f34feb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.032567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.033648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.034077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.034494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.049476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7ba1-fc62-48e7-a408-24ffa8bd9f87 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.056611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:27.064991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:27.065921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:27.066748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:27.070555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 171/345] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:27.071657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.096942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.097830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.098119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.098776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.103276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.103276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.104189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 175/346] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:26 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:27.107232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.251688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eb0f7-090c-439a-a57c-c6b1a3336e40 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.277729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6d914-9fd0-49dd-abd9-0729535f1944 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.320333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.321351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.321843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.322268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.323024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.323382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:27.323767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.324005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.324116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.324321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.325236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:27.325749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.326194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.327182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.335851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 176/347] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:27.337368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.344620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 172/348] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:27.348829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.452512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c3ed5-9f2f-492e-970a-f838d1ba095e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.494940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c32698-9af8-4922-9105-bc6f90cd1d27 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.496544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.497647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.497947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.498232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.519936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.521418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.523359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 177/349] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:27.523974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.539197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a6b5-718e-4f29-8e13-a1573412a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.539884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a6b5-718e-4f29-8e13-a1573412a67e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.540330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a6b5-718e-4f29-8e13-a1573412a67e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.540777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a6b5-718e-4f29-8e13-a1573412a67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.613300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a6b5-718e-4f29-8e13-a1573412a67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.615018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a6b5-718e-4f29-8e13-a1573412a67e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.633370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece34e3-fe1b-424c-97be-210ee4d1e516 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.671644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2439-fd98-4fc0-9193-73757ef1b67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.672580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2439-fd98-4fc0-9193-73757ef1b67c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.673050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2439-fd98-4fc0-9193-73757ef1b67c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.673492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2439-fd98-4fc0-9193-73757ef1b67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.725274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 173/350] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:27.726589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8067-1b2b-4ab8-8c57-e63a9e896d1b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.726882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8067-1b2b-4ab8-8c57-e63a9e896d1b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.727289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8067-1b2b-4ab8-8c57-e63a9e896d1b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.728585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 174/351] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:27.729696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8067-1b2b-4ab8-8c57-e63a9e896d1b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.753907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2439-fd98-4fc0-9193-73757ef1b67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.755073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2439-fd98-4fc0-9193-73757ef1b67c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.850287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8067-1b2b-4ab8-8c57-e63a9e896d1b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:27.881721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 178/352] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:27.884267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6d62-e3c0-4829-91cf-3e0c05b3e3b4 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.884890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6d62-e3c0-4829-91cf-3e0c05b3e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.885437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca6d62-e3c0-4829-91cf-3e0c05b3e3b4 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.885945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:27.886599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.886930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.887211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.888685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:27.888994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:27.889265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 179/353] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:27.890300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca6d62-e3c0-4829-91cf-3e0c05b3e3b4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:27.890413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3184cb7-daf8-4e82-81b8-f16e040c6d2e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:27.897004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 175/354] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:27.898446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:27.898874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:27.899307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:27.916922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:27.918406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:27.997970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 176/355] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:28.000200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.026068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca6d62-e3c0-4829-91cf-3e0c05b3e3b4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.081082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a15d-1bfe-410b-a40f-29bc93ec228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.082294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a15d-1bfe-410b-a40f-29bc93ec228c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.083034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a15d-1bfe-410b-a40f-29bc93ec228c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.086268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a15d-1bfe-410b-a40f-29bc93ec228c None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.086268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369a15d-1bfe-410b-a40f-29bc93ec228c None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:28.087476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369a15d-1bfe-410b-a40f-29bc93ec228c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:28.089877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 180/356] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:28.091772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.092061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.092338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.113714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:28.114808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:28.141823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae752-7d0a-493d-9d91-08ff5c3c7daf None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.189709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623a5a-0446-4d3f-bff4-d0c676b39fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.190575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623a5a-0446-4d3f-bff4-d0c676b39fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.190857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623a5a-0446-4d3f-bff4-d0c676b39fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.191126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623a5a-0446-4d3f-bff4-d0c676b39fb0 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.192411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623a5a-0446-4d3f-bff4-d0c676b39fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:28.193846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623a5a-0446-4d3f-bff4-d0c676b39fb0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:28.199921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 177/357] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:27 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:28.199921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2251dd-07a1-4f76-b776-dc2cc16dd4aa None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.199921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2251dd-07a1-4f76-b776-dc2cc16dd4aa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.199921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2251dd-07a1-4f76-b776-dc2cc16dd4aa None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.202055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 178/358] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:28.203337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2251dd-07a1-4f76-b776-dc2cc16dd4aa None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.206062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 181/359] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:28.207166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.333280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78dcd5-895a-4a2e-8efe-291fb1d60817 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.333953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2251dd-07a1-4f76-b776-dc2cc16dd4aa None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.375465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.375826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eac57-83c5-4315-960c-d99b5c41110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.376258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.376542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.376639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eac57-83c5-4315-960c-d99b5c41110f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.376817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.376911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eac57-83c5-4315-960c-d99b5c41110f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.377161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eac57-83c5-4315-960c-d99b5c41110f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.377986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:28.382548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:28.382548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 182/360] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:28.382548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.396525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2eac57-83c5-4315-960c-d99b5c41110f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-de2eac57-83c5-4315-960c-d99b5c41110f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:28.408034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:28.408992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 179/361] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:28.415503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.416304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.416304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.429855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:28.431039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:28.517477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 180/362] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:28.518135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.521012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039b4f-20cc-4d25-b114-27a42471b073 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.564777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.565285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.565568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.565835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.567219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:28.568883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:28.571076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 183/363] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:28.572059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.647065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be94d5-e724-46e5-96b6-6489be37a02d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.695384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ad5cd-bc5f-495e-a457-d05220e09988 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.695861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.696667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.696953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.697227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.711429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:28.720846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:28.721783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:28.722923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 181/364] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:28.723645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.745118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.745864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.746147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.746421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.747865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=737352b3ae13476fb229cde50784b960) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:28.748919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:28.752490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:28.758935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 184/365] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:28.763280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.862039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5fc5-142f-4361-a3ae-d637ce54a171 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.901593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd2964-d692-459e-afe0-1e6d42dedade None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:28.905247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.905926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.906208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.906484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.907246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:28.908630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:28.910057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:28.919858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 182/366] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:28.920735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:28.948052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:28.948866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:28.949145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:28.949417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:28.971703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:28.979536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:28.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:28.981955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 185/367] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:28.982619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.073398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd437e49-faab-4f11-bd0e-a834014906c3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.111326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.112004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.112286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.112558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.113399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:29.113711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.115051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cd6d9-f75a-47a0-bdab-d50f0bfe03bf None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.115167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.122982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 183/368] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=aa3a7655caa4456091096e448052a63b => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:29.123952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.154349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.155661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.155952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.156507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.157278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:29.157748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.159819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.171932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 186/369] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:29.172807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.239775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4963472-d0b9-4ce6-b748-d88d4aa8f047 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.280514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.281208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.281536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.281808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.304187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020fd2d-556e-43f6-aff7-d85bcd4dee51 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.344552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.345387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.345674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.346270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.347340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:29.347651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.349534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.355770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.358064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.360610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 187/370] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:29.361456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.476872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 184/371] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:29.478745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.489512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58857a-a318-4275-a53d-fde9d2ff8adf None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.531420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.532895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.532895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.532895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] PATH_INFO: `/v3/users/025c1446528f488d90bac20b63fc6b9e` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.539277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] RBAC: Authorizing `identity:get_user(user_id=025c1446528f488d90bac20b63fc6b9e)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.539277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.543371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 188/372] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:08:29 2022] GET /identity/v3/users/025c1446528f488d90bac20b63fc6b9e => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:29.544280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.665289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676c133-5015-4745-a046-b287f69905d1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.707343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49efca-1221-4361-bc0b-cd20c0c0d81c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:29.726396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.727106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.727355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.727636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.768991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:29.769924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:29.770209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:29.770488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:29.771822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.773268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.777652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 189/373] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:29 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:29.779891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:29.857085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:29.858627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:29.954010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f016-7ba8-412e-8b19-1a292a8203b0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:30.018339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:30.019554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.019842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.020118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.020953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] RBAC: Adding query filter params (role.id=1e187930497e4bd3af06094b1540c1db, user.id=025c1446528f488d90bac20b63fc6b9e, scope.system=all) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:30.021266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:30.022695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:30.049264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 190/374] 10.222.0.42 () {56 vars in 1308 bytes} [Tue May 3 16:08:29 2022] GET /identity/v3/role_assignments?user.id=025c1446528f488d90bac20b63fc6b9e&scope.system=all&role.id=1e187930497e4bd3af06094b1540c1db => generated 510 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:30.050092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:30.052362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 185/375] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:30.068974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:30.244122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782c15-d5c5-4417-8b16-94f58d42b246 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:30.249910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f31d24-3be6-4ea0-bdad-52544a0c7f58 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:30.287587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:30.288455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.288737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.289012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] PATH_INFO: `/v3/projects/edec15e0ee20483fb7e945e977a36993` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.290237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] RBAC: Authorizing `identity:get_project(project_id=edec15e0ee20483fb7e945e977a36993)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:30.291726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:30.292588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:30.294014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.294468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.294750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.296019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:30.297469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:30.298758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 186/376] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:30 2022] GET /identity/v3/projects/edec15e0ee20483fb7e945e977a36993 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:30.299518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 191/377] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:30 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:30.300350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:30.333491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:30.418261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2f590-3dac-41b1-aaf2-e8c4ae2014c0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:30.456303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:30.457166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.457497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.457772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] PATH_INFO: `/v3/groups/3536c81d28a54923a5e0aec47c23f9bc` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.464412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] RBAC: Authorizing `identity:get_group(group_id=3536c81d28a54923a5e0aec47c23f9bc)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:30.466214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:30.471367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 187/378] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:30 2022] GET /identity/v3/groups/3536c81d28a54923a5e0aec47c23f9bc => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:30.472947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9631-9946-4bcb-b279-facf2b9bc92d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:30.473976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:30.527647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:30.528353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.528634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.528904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.529741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=737352b3ae13476fb229cde50784b960) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:30.530056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:30.531507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d70a5-e467-4aac-b2cf-8d4459ff5748 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:30.537366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 192/379] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:30 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=aa3a7655caa4456091096e448052a63b => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:30.586291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fbffd-6ca4-4fb5-810d-ba0f2cfcd5d5 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:30.626974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:30.627691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.627975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.628251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.629088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] RBAC: Adding query filter params (group.id=3536c81d28a54923a5e0aec47c23f9bc, role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=edec15e0ee20483fb7e945e977a36993) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:30.629400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:30.630872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc12f1-6acc-4c79-9b7d-3048d3fc80bb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:30.639167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 188/380] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:30 2022] GET /identity/v3/role_assignments?group.id=3536c81d28a54923a5e0aec47c23f9bc&scope.project.id=edec15e0ee20483fb7e945e977a36993&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:30.860755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf607-ed2a-4b54-a0a4-4f043064a618 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.860960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf607-ed2a-4b54-a0a4-4f043064a618 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.861506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf607-ed2a-4b54-a0a4-4f043064a618 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.863063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 193/381] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:30.869624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:30.869914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:30.870194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:30.892242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:30.893700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:30.982687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 189/382] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:31.007903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf607-ed2a-4b54-a0a4-4f043064a618 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:31.136018 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf607-ed2a-4b54-a0a4-4f043064a618 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:31.183658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:31.184683 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:31.184967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:31.185242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:31.197225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:31.209276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:31.210177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:31.211000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 194/383] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:31.220356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:31.356679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb55d4-f80d-49f1-a150-619d876ba947 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:31.392220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:31.393232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:31.393960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:31.394428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:31.395389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:31.395912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:31.397478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22083fa-8dca-42a1-a4ff-c6c7fe3defd4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:31.407381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 190/384] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:31.413545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:31.596707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67571ffe-d916-426f-b03f-e3baa30960fb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:31.621132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830803a-8fd6-4806-9bea-52a41f462991 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:31.621423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830803a-8fd6-4806-9bea-52a41f462991 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:31.622238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830803a-8fd6-4806-9bea-52a41f462991 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:31.623788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 191/385] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:31.629226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:31.629796 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:31.630272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:31.639970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:31.640837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:31.641124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:31.641403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:31.643653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:31.644338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:31.646291 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 195/386] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:31 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:31.651166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:31.657154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:31.658578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:31.742759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 192/387] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:31.777735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:31.794005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3375-207c-432d-b5fd-b8d11445a7a6 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:31.829240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:31.830156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:31.830419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:31.830702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:31.831954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:31.833415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:31.835442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 196/388] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:31 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:31.842895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:31.964984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ee1d-ab91-4942-ae51-38e164b8ea6c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.005493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a6419-577c-4c6f-ae4b-a73f560f62e7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.035666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.036823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.037318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.037801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.054734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:32.063985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:32.064878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:32.065672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:32.070216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 193/389] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:32.078840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.080435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.080941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.081425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/groups/275bd99efd3a40248482d2100cbf519b/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.084533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9514039f9ea4ae396dba2f3c31b7ad1, group_id=275bd99efd3a40248482d2100cbf519b, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:32.086192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:32.090797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:32.170431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 197/390] 10.222.0.42 () {58 vars in 1442 bytes} [Tue May 3 16:08:31 2022] PUT /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/groups/275bd99efd3a40248482d2100cbf519b/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:08:32.215181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a3257-f079-47a1-a12b-65d9fa474cac None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.260284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.261856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.262390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.262894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.263939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:32.264464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:32.266193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c464293-db12-4b17-9134-df81fcb5068b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:32.277020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 194/391] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:32.284349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:32.432712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccc3cb-c597-42c6-a4a3-20acb4e9efb4 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.462251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421511-8500-44fb-9d6e-bc14c2c9b6f5 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.462565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421511-8500-44fb-9d6e-bc14c2c9b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.462852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4421511-8500-44fb-9d6e-bc14c2c9b6f5 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.465776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 195/392] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:32.469832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.470120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.470396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.479986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.482050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.482484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.482774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.484007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:32.485457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:32.487458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 198/393] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:32 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:32.492331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:32.493529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:32.496385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:32.604832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058681-6c9c-41b1-8275-2af66e8e3c59 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.642928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.644081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.644362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.644640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.646797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:32.648281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:32.649999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 199/394] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:32 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:32.655537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 196/395] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:32.657501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:32.723195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:32.795760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7789cd-0a17-4fa6-8e08-649be99cd344 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.861735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.862627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.862917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.863194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960/groups/275bd99efd3a40248482d2100cbf519b/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.867285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] RBAC: Authorizing `identity:create_grant(project_id=737352b3ae13476fb229cde50784b960, group_id=275bd99efd3a40248482d2100cbf519b, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:32.868736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:32.895314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b267f61-fa5a-4550-bce5-053430563ada None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:32.930259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:32.931119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:32.931442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:32.931719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:32.948749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 200/396] 10.222.0.42 () {58 vars in 1442 bytes} [Tue May 3 16:08:32 2022] PUT /identity/v3/projects/737352b3ae13476fb229cde50784b960/groups/275bd99efd3a40248482d2100cbf519b/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:32.949337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:32.958790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:32.965913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:32.966854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 197/397] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:32.973147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:33.100432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db011f-2001-4669-a6da-3f2386bdfd2e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:33.143059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:33.144167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.144456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.144721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.145534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:33.145842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:33.147301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:33.158453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 201/398] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:33.168523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:33.309062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72443c-7260-482f-b3c9-9d0e917211a6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:33.353254 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:33.354037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.354314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.354580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.359969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:33.361415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:33.363448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 198/399] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:33 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:33.368817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:33.508949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cfe5e-8709-409a-afea-581a341709e1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:33.545974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02165cc0-b2f1-432a-9a50-6a481346cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:33.546827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02165cc0-b2f1-432a-9a50-6a481346cf77 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.547104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02165cc0-b2f1-432a-9a50-6a481346cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.547405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02165cc0-b2f1-432a-9a50-6a481346cf77 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.548582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02165cc0-b2f1-432a-9a50-6a481346cf77 None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:33.550011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02165cc0-b2f1-432a-9a50-6a481346cf77 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:33.551999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 202/400] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:33 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:33.557745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:33.668799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d6fb9-783e-488a-9339-a82cc92bdce7 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:33.709532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767132a-0d7f-4c8c-9ae1-b4cc5ecf8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:33.710456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767132a-0d7f-4c8c-9ae1-b4cc5ecf8fe7 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.710738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767132a-0d7f-4c8c-9ae1-b4cc5ecf8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.711010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767132a-0d7f-4c8c-9ae1-b4cc5ecf8fe7 None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/groups/275bd99efd3a40248482d2100cbf519b/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.713255 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767132a-0d7f-4c8c-9ae1-b4cc5ecf8fe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9514039f9ea4ae396dba2f3c31b7ad1, group_id=275bd99efd3a40248482d2100cbf519b, role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:33.714673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767132a-0d7f-4c8c-9ae1-b4cc5ecf8fe7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:33.810526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce964-83fe-4226-ac05-a52ffbeff720 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.810868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce964-83fe-4226-ac05-a52ffbeff720 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.811124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce964-83fe-4226-ac05-a52ffbeff720 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.812945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 203/401] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:33.819885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.819885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.819885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.835466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:33.836649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:33.863688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 199/402] 10.222.0.42 () {58 vars in 1442 bytes} [Tue May 3 16:08:33 2022] PUT /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1/groups/275bd99efd3a40248482d2100cbf519b/roles/aa3a7655caa4456091096e448052a63b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:33.870654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087969db-089a-4bb1-b1fe-21e29c752684 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.870654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087969db-089a-4bb1-b1fe-21e29c752684 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.870654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087969db-089a-4bb1-b1fe-21e29c752684 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.870654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 200/403] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:33.873083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:33.873379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:33.873662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:33.891919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:33.893135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:33.919575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 204/404] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:33.982137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:33.996202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 201/405] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:34.024372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.138130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5805a-2abd-4787-9ecd-d601a5a96e97 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.163983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f301dd-a214-46dc-a8f7-5a1fc9905e7e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.193893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.194613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.194889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.195157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.214582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:34.223995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.224800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.225078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.225346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:34.227619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:34.228519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:34.229304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:34.234466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 205/406] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:34.240202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.253929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:34.262258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:34.264673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:34.267279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:34.275143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 202/407] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:34.285459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.380522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f621d5-ca94-42e5-8ac6-3ba75e97f025 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.417727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.418458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.418747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.419025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.419837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:34.420145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:34.421525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:34.430550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 206/408] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:34.437211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.502431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e6c7-7e5d-421e-9ee5-ab2bf333989b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.542587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d57d9-9c41-44b2-b6a3-65050674b76e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.582656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.582855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.583356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.583544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.583637 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.583832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.583922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.584120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] PATH_INFO: `/v3/groups/3536c81d28a54923a5e0aec47c23f9bc` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.584721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:34.585031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:34.585285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] RBAC: Authorizing `identity:get_group(group_id=3536c81d28a54923a5e0aec47c23f9bc)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:34.586416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:34.586793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:34.588810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 207/409] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/groups/3536c81d28a54923a5e0aec47c23f9bc => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:34.595751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.603353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 203/410] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:34.612716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.704314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e65f-6633-441f-8b1a-5b23166c4d7a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.738605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.739499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.739784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.740059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] PATH_INFO: `/v3/projects/edec15e0ee20483fb7e945e977a36993` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.743278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] RBAC: Authorizing `identity:get_project(project_id=edec15e0ee20483fb7e945e977a36993)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:34.743278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:34.744828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 208/411] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/projects/edec15e0ee20483fb7e945e977a36993 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:34.751210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.838986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6c73a-2ac0-42ba-a52b-4f03a90a6974 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.860892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626b833-542c-4211-a82a-6486789e6429 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:34.898764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e21de0-72f6-425b-b825-0b05a30f05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.899751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e21de0-72f6-425b-b825-0b05a30f05d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.903273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e21de0-72f6-425b-b825-0b05a30f05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.903273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e21de0-72f6-425b-b825-0b05a30f05d3 None admin] PATH_INFO: `/v3/projects/edec15e0ee20483fb7e945e977a36993/groups/3536c81d28a54923a5e0aec47c23f9bc/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.903273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e21de0-72f6-425b-b825-0b05a30f05d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=edec15e0ee20483fb7e945e977a36993, group_id=3536c81d28a54923a5e0aec47c23f9bc, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:34.904620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e21de0-72f6-425b-b825-0b05a30f05d3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:34.913379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:34.914775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:34.915296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:34.915735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:34.917138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:34.928372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:34.928372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 204/412] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:34.928372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:34.978268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 209/413] 10.222.0.42 () {58 vars in 1442 bytes} [Tue May 3 16:08:34 2022] PUT /identity/v3/projects/edec15e0ee20483fb7e945e977a36993/groups/3536c81d28a54923a5e0aec47c23f9bc/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:35.023207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ebb02-e4b9-4bad-b949-63a99576acbf None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.023595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ebb02-e4b9-4bad-b949-63a99576acbf None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.023814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ebb02-e4b9-4bad-b949-63a99576acbf None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.025567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 210/414] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:35.031089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.031408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.031687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.064463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fcbaa-2e51-4fb5-b6e1-c4dbb29f33bb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:35.064671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:35.066234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:35.110355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:35.111199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.111518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.111797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.113870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:35.115446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:35.117613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 205/415] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:34 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:35.124363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:35.245783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 211/416] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:35.248661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca0f7-703b-4c01-a7c5-c600e2fa567c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:35.270588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:35.289211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:35.290206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.290700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.291033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960/groups/275bd99efd3a40248482d2100cbf519b/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.293861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=737352b3ae13476fb229cde50784b960, group_id=275bd99efd3a40248482d2100cbf519b, role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:35.295949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:35.383848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 206/417] 10.222.0.42 () {58 vars in 1442 bytes} [Tue May 3 16:08:35 2022] PUT /identity/v3/projects/737352b3ae13476fb229cde50784b960/groups/275bd99efd3a40248482d2100cbf519b/roles/aa3a7655caa4456091096e448052a63b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:35.401102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1ecbd-0a29-4f6a-a8b9-3de848e676b7 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:35.458810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7972c7d-6c4a-42f7-bda2-ef3f45ccfa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:35.459661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7972c7d-6c4a-42f7-bda2-ef3f45ccfa14 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.459948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7972c7d-6c4a-42f7-bda2-ef3f45ccfa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.460223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7972c7d-6c4a-42f7-bda2-ef3f45ccfa14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.477336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7972c7d-6c4a-42f7-bda2-ef3f45ccfa14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-e7972c7d-6c4a-42f7-bda2-ef3f45ccfa14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:35.486222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:35.488726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:35.490242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 212/418] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:35.495194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:35.627931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5992-6451-4e0e-9191-801fe45c77d4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:35.634060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac79e5-694e-4db0-8c57-c832acca4345 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.634246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac79e5-694e-4db0-8c57-c832acca4345 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.634528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac79e5-694e-4db0-8c57-c832acca4345 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.636243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 213/419] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:35.642088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.642396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.642651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.666611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:35.668036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:35.697235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:35.697919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.698199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.698471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.699224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:35.700081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:35.701487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:35.716437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 207/420] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:35.722359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:35.812973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 214/421] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:35.832571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca249168-64c5-41a0-ac39-41dc9ba6f2b9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:35.836810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:35.869564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:35.870220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.870524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.870800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.939439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635c2dc-79af-4850-816f-8bf675e6dd73 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:35.943447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:35.944955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:35.973952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:35.974749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:35.975042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:35.975413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:35.993895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:36.005693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:36.006625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:36.008549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 215/422] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:36.018927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.142388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 208/423] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:36.148820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.160681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284606-ac61-43c1-9dbe-15010cee3f66 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:36.194190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:36.194782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.195058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.195366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.196102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] RBAC: Adding query filter params (name=member) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:36.196406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:36.197781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:36.207112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 216/424] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:36.212383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.313466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19651c2-d1e1-4e10-b160-fa6e00290496 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:36.354356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:36.355005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.355307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.356095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.366084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35b2-0308-4769-b235-d7e812ad3d5d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:36.432603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:36.435827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.435827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.435827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.436644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:36.438086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:36.440652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 209/425] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:36.450745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.475351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:36.476814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:36.568523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec90f3-3d87-4b57-b90c-543460b5882f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:36.607003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:36.610114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.611828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.613010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.616053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:36.618463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:36.621107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 210/426] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:36.633046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.659384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 217/427] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:36.665259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.773565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929061d-75ec-4c63-8c90-31148f198002 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:36.803647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cb440-45b6-4133-981c-16d009678845 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:36.809990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:36.810977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.811506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.812140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.813179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:36.813704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:36.815428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f65877-0f93-44d5-b487-c9b383839b10 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:36.827411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 211/428] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:36.829261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89f45-7778-49ed-ad6e-505ecaa841cc None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.829764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89f45-7778-49ed-ad6e-505ecaa841cc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.831784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89f45-7778-49ed-ad6e-505ecaa841cc None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.833429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 212/429] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:36.839682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.840846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.841339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.846758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:36.847814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:36.848104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:36.848450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:36.849717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:36.851301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:36.853592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 218/430] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:36.859408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:36.873031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:36.874460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:36.980637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a196a7c-397e-4504-b65e-a7bcf8f65abd None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.014070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 213/431] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:37.026954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.028374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.028765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.029156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.030624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:37.032257 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:37.041231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 219/432] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:36 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:37.047681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.054541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.172804 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880099e-2190-4bf6-a7a3-3e5550164148 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.219398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.220916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.220916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.221262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.235750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a118b-19c8-4a2b-b870-a3dc1a20d54d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.236139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:37.247289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:37.248358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:37.249324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:37.251723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 220/433] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:37.257800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.280936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.281891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.282341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.282847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.283978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=a39aa06b3d53485e8b99f7660fba1306, scope.project.id=737352b3ae13476fb229cde50784b960) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:37.284535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:37.286224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:37.294164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 214/434] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=a39aa06b3d53485e8b99f7660fba1306 => generated 611 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:37.384982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3c8ea-929f-4b22-8916-17dc52eac11d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.423415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.424102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.424383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.424657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.425457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:37.425759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:37.427270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c954599-b709-4407-887f-88c8ff01c520 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:37.437347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 221/435] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:37.443154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.531349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e66d-cef0-4bcb-896b-7dd0df60196d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.532666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e66d-cef0-4bcb-896b-7dd0df60196d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.532943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e66d-cef0-4bcb-896b-7dd0df60196d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.534551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 222/436] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:37.541131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.541454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.541684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.564025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:37.565192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:37.579598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0b64f-cede-45c1-ad52-c3a52149350d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.625566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.626224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.626503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.626776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.647612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 223/437] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:37.672982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.713999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:37.716347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:37.796627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7d28-07e1-4321-be3b-d208d0fde3fd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.828157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 215/438] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:37.831846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85899ff9-3483-4048-a524-f283f759787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.832709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85899ff9-3483-4048-a524-f283f759787e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.832999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85899ff9-3483-4048-a524-f283f759787e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.833276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85899ff9-3483-4048-a524-f283f759787e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.833545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.844268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85899ff9-3483-4048-a524-f283f759787e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-85899ff9-3483-4048-a524-f283f759787e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:37.851959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:37.852868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 224/439] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:37.859574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85899ff9-3483-4048-a524-f283f759787e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.929840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd885ea-3f08-41a1-beec-72bb4811fe9b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.957949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85899ff9-3483-4048-a524-f283f759787e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:37.963137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.964019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.964308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.964583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] PATH_INFO: `/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.965939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] RBAC: Authorizing `identity:get_project(project_id=b9514039f9ea4ae396dba2f3c31b7ad1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:37.967397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:37.969262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 216/440] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/projects/b9514039f9ea4ae396dba2f3c31b7ad1 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:37.974485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:37.992839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55770f67-aa18-411f-a669-d94967497166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:37.993505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770f67-aa18-411f-a669-d94967497166 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:37.993790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770f67-aa18-411f-a669-d94967497166 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:37.994071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770f67-aa18-411f-a669-d94967497166 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:37.994820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55770f67-aa18-411f-a669-d94967497166 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:37.995128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55770f67-aa18-411f-a669-d94967497166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:37.996631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55770f67-aa18-411f-a669-d94967497166 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.009394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 225/441] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:38.010105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55770f67-aa18-411f-a669-d94967497166 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.076150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587ce46-8ff5-4c79-aa6c-afaccb229e8a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.109576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.110694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.111127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.111297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55770f67-aa18-411f-a669-d94967497166 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.111713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.113250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.114915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.116863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 217/442] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:37 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:38.124492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.150396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.151054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.151370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.151654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.220492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.221965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.241394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb55f-b75b-4a6e-9eab-8bde705f6d5a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.277296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.278584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.278871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.279151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.280002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:38.280314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.281737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0977d35-8fab-477e-bb42-eb5a1682bb49 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.287951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 218/443] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=b9514039f9ea4ae396dba2f3c31b7ad1&role.id=aa3a7655caa4456091096e448052a63b => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:38.309784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ce53-04db-4a8a-93d3-c69bed2a7542 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.310080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ce53-04db-4a8a-93d3-c69bed2a7542 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.310363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ce53-04db-4a8a-93d3-c69bed2a7542 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.311831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 219/444] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:38.317669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.317957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.318235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.330033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 226/445] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:38.335154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.337318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:38.338559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:38.414433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 220/446] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:38.439121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.442582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad3aa5-1b30-4634-9455-f570478e8609 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.488737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.489601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.489884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.490160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] PATH_INFO: `/v3/projects/edec15e0ee20483fb7e945e977a36993` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.491470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] RBAC: Authorizing `identity:get_project(project_id=edec15e0ee20483fb7e945e977a36993)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.493768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.497509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 227/447] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/projects/edec15e0ee20483fb7e945e977a36993 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:38.500357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.565526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80f98-7b52-4b33-91a8-f16870ed89f1 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.603717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.604443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.604719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.605999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.614125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4d334-af53-40f5-8599-f8d00e55d502 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.616889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:38.625397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:38.626301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:38.627424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:38.631413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 221/448] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:38.632613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.655077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.655641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.655936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.656211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] PATH_INFO: `/v3/groups/3536c81d28a54923a5e0aec47c23f9bc` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.657412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] RBAC: Authorizing `identity:get_group(group_id=3536c81d28a54923a5e0aec47c23f9bc)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.658868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.667130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 228/449] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/groups/3536c81d28a54923a5e0aec47c23f9bc => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:38.667130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.750014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520dba-4267-4368-9c6c-a40070f982cc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.784156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aba188-77a3-4e09-9b6a-528a6d9f4e42 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.789991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.790372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.790656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.790931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.791729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:38.792036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.793464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.804157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 222/450] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:38.810202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:38.821842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.822506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.822786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.823060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:38.823932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] RBAC: Adding query filter params (group.id=3536c81d28a54923a5e0aec47c23f9bc, role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=edec15e0ee20483fb7e945e977a36993) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:38.824300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:38.826219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:38.832931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 229/451] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/role_assignments?group.id=3536c81d28a54923a5e0aec47c23f9bc&scope.project.id=edec15e0ee20483fb7e945e977a36993&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:38.918486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3587773-4f92-49d5-9051-d2d6f8284493 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:38.953132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:38.953793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:38.954072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:38.954346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:39.021051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:39.022526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:39.116859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 223/452] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 16:08:39.122466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:39.215987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658ec89-aa62-4c93-bd4b-e17902e1bc7a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:39.246877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:39.247759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:39.248038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:39.248309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] PATH_INFO: `/v3/projects/737352b3ae13476fb229cde50784b960` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:39.249497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] RBAC: Authorizing `identity:get_project(project_id=737352b3ae13476fb229cde50784b960)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:39.251029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:39.252692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 230/453] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:08:39 2022] GET /identity/v3/projects/737352b3ae13476fb229cde50784b960 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:39.258218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:39.350936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88c66-500a-4c6f-80d3-a9fb3810a7a2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:39.382062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53f29-8ee3-4b8e-9896-688530c7b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:39.382887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53f29-8ee3-4b8e-9896-688530c7b945 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:39.383163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53f29-8ee3-4b8e-9896-688530c7b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:39.383458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53f29-8ee3-4b8e-9896-688530c7b945 None admin] PATH_INFO: `/v3/groups/275bd99efd3a40248482d2100cbf519b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:39.384599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa53f29-8ee3-4b8e-9896-688530c7b945 None admin] RBAC: Authorizing `identity:get_group(group_id=275bd99efd3a40248482d2100cbf519b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:39.386027 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa53f29-8ee3-4b8e-9896-688530c7b945 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:39.389838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 224/454] 10.222.0.42 () {56 vars in 1180 bytes} [Tue May 3 16:08:39 2022] GET /identity/v3/groups/275bd99efd3a40248482d2100cbf519b => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:39.395994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:39.491100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86e86-ab9c-42e8-8ed3-1aa112715056 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:39.523943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:39.524593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:39.524880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:39.525159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:39.525983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] RBAC: Adding query filter params (group.id=275bd99efd3a40248482d2100cbf519b, role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=737352b3ae13476fb229cde50784b960) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:39.526295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:39.528463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b52c7-982f-43a9-95e3-ee71332ecd27 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:39.534095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 231/455] 10.222.0.42 () {56 vars in 1376 bytes} [Tue May 3 16:08:39 2022] GET /identity/v3/role_assignments?group.id=275bd99efd3a40248482d2100cbf519b&scope.project.id=737352b3ae13476fb229cde50784b960&role.id=aa3a7655caa4456091096e448052a63b => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:42.555903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd574c-d2cb-459a-b404-06701ab083aa None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:42.556418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd574c-d2cb-459a-b404-06701ab083aa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:42.556522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd574c-d2cb-459a-b404-06701ab083aa None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:42.558173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 225/456] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:42.563934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188170-e197-4f54-a332-b61110978163 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:42.564763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188170-e197-4f54-a332-b61110978163 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:42.565206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188170-e197-4f54-a332-b61110978163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:42.583660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-27188170-e197-4f54-a332-b61110978163 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:42.585101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-27188170-e197-4f54-a332-b61110978163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:42.626866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b587-eb9a-4a57-959f-7552f104f4f6 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:42.627191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b587-eb9a-4a57-959f-7552f104f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:42.627500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b587-eb9a-4a57-959f-7552f104f4f6 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:42.629264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 226/457] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:42.634519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:42.634826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:42.635130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:42.662643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:42.663877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:42.665508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 232/458] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:42.700888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188170-e197-4f54-a332-b61110978163 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:42.778850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 227/459] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:42.806896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188170-e197-4f54-a332-b61110978163 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:42.820325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:42.842071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:42.843231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:42.843755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:42.844238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:42.854721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:42.857091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:42.874944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:42.875868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:42.876721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:42.876721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:42.876721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:42.876721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:42.878917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 233/460] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:42.884725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:42.973986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7124-be86-4310-adfc-e3fa4e3e0ed9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:42.997062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286de0a-7623-4422-a88a-2a91fff14975 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.009809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.010519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.010803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.011079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.021860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.023540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.034561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.035536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.036093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.036563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.037473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:43.037975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.039558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9190ea-846c-4bac-91ca-83028fb0135c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-710d8dc1-127c-4710-8f0d-9f0a8dd426cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:43.042281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:43.043746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:43.044686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:43.044686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:43.044686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:43.044686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:43.049020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 228/461] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:43.050336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ad40-9fbf-41cc-8515-4ff9f75a0a5d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.050626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ad40-9fbf-41cc-8515-4ff9f75a0a5d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.050902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ad40-9fbf-41cc-8515-4ff9f75a0a5d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.052288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 229/462] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:43.052985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ad40-9fbf-41cc-8515-4ff9f75a0a5d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.056869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 234/463] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:43.063391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.063964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.064442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.081696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:43.083208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:43.159304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 235/464] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:43.159304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.159611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ad40-9fbf-41cc-8515-4ff9f75a0a5d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.193156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.193818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.194101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.194377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.195098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:43.195438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.196828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4f2d-b5e4-4132-b208-c017ff8e8cff None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.214371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 230/465] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:43.215858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f74ce-6781-4ee7-850c-187c412832aa None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.216149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f74ce-6781-4ee7-850c-187c412832aa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.216429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f74ce-6781-4ee7-850c-187c412832aa None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.217751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 231/466] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:43.219742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f74ce-6781-4ee7-850c-187c412832aa None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.271293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70181840-44da-43f9-aa21-9ce160d7d638 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.305528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc62cc-a483-4957-ad42-560af9b718aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.306120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc62cc-a483-4957-ad42-560af9b718aa None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.306405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc62cc-a483-4957-ad42-560af9b718aa None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.306927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc62cc-a483-4957-ad42-560af9b718aa None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.307408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc62cc-a483-4957-ad42-560af9b718aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.309366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc62cc-a483-4957-ad42-560af9b718aa None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.320156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f74ce-6781-4ee7-850c-187c412832aa None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.352846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.353633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.353914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.354187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.364479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.365924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:43.383818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:43.384648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:43.385496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:43.385496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:43.385496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:43.385496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:43.386089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 232/467] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:43.387616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.483284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 236/468] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:43 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:43.483284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.483284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.483284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.494269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:43.497831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:43.498226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fafc-ebf7-47a1-b589-0255e766969b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.546311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.547150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.547597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.547941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.548758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.550546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.597595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 237/469] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:43.599066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.640885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 233/470] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:43 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:43.648467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.717647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f195b0-56a1-4e55-be56-4f1f434dbeb6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.757426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.758481 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.759019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.759328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.760084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:43.760394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.762594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641c72-e4d9-47e6-8ff4-eb1b6a6a0e32 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.777811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 238/471] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:43.779543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4ed0-6ebb-4883-a113-6a9484ae07d4 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.780046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4ed0-6ebb-4883-a113-6a9484ae07d4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.780525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4ed0-6ebb-4883-a113-6a9484ae07d4 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.782163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 239/472] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:43.784415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4ed0-6ebb-4883-a113-6a9484ae07d4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:43.791525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336e30-b897-48f1-827b-eae8826a0c93 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.838765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.840439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.840725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.845977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.854689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.856878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-146b1d3d-7745-49b9-92fe-903055c6c0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:43.881019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:43.887021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 234/473] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.888728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.909398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:43.910357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:43.918336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4ed0-6ebb-4883-a113-6a9484ae07d4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:43.961931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:43.962614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:43.962900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:43.963180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:43.964053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:43.965580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:43.994017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 235/474] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:43.994955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:44.075438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 240/475] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:43 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:44.077093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:44.108379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14946c6-87c9-4c85-a7c6-ff7516e543aa None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:44.150248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:44.150925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:44.151286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:44.151504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:44.152758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:44.153059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:44.154419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:44.166540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 236/476] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:44.172736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:44.194900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d70d-e1f3-4cc4-8734-9007f8bd79de None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:44.231516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:44.232569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:44.233073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:44.233565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:44.234633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:44.236253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:44.278318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de94f-5576-4d8f-895a-2bdb4f47c629 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:44.315194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:44.315911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:44.316189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:44.316461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:44.317170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:44.319036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:44.320306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.sql.core [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 16:08:44.320306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 16:08:44.320306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [parameters: {'id': '9949c0fcf6e14fbaad48d1ff80a3d1c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 16:08:44.320306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80030) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result = self._query(query) May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application conn.query(q) May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result.read() May 03 16:08:44.344505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return ref.to_dict() May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 16:08:44.345418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application next(self.gen) May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application yield resource May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application next(self.gen) May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.session.rollback() May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.force_reraise() May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise self.value May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application session.commit() May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 16:08:44.346371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._prepare_impl() May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.session.flush() May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._flush(objects) May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application compat.raise_( May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application flush_context.execute() May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rec.execute(self) May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 16:08:44.347224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 16:08:44.348118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result = self._query(query) May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application conn.query(q) May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result.read() May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 16:08:44.348939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [parameters: {'id': '9949c0fcf6e14fbaad48d1ff80a3d1c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:44.349704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 16:08:44.350492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:44.352765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 241/477] 10.222.0.42 () {60 vars in 1131 bytes} [Tue May 3 16:08:44 2022] POST /identity/v3/roles => generated 144 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:44.352765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:44.394462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:44 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:08:44.471562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb11814-3f59-4057-a704-1f2fbdc3eaaa None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:44.510496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1ce65-71f3-44de-9ac0-bd816a617c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:44.511411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1ce65-71f3-44de-9ac0-bd816a617c7b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:44.511914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1ce65-71f3-44de-9ac0-bd816a617c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:44.512314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1ce65-71f3-44de-9ac0-bd816a617c7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:44.524788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1ce65-71f3-44de-9ac0-bd816a617c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d8f1ce65-71f3-44de-9ac0-bd816a617c7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:44.533622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:44.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:44.535473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 242/479] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:08:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:44.541158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:44.649797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22a947-6bce-43c8-913d-e48231ce6a92 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:44.684751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:44.685410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:44.685696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:44.685982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:44.686735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:44.687044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:44.688533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fb186-df8a-4486-95bf-2a63e11db976 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:44.697696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 238/480] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:46.221856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794309c-61f1-4156-8c34-1371e020cb52 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.222390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794309c-61f1-4156-8c34-1371e020cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.222390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794309c-61f1-4156-8c34-1371e020cb52 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.224053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 243/481] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:46.232481 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa6b9-c333-482a-a5ed-951b41508f00 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.232952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa6b9-c333-482a-a5ed-951b41508f00 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.233035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa6b9-c333-482a-a5ed-951b41508f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.257088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-67ffa6b9-c333-482a-a5ed-951b41508f00 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:46.258314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-67ffa6b9-c333-482a-a5ed-951b41508f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:46.357904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:46.404750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794309c-61f1-4156-8c34-1371e020cb52 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:46.568876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794309c-61f1-4156-8c34-1371e020cb52 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:46.580912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d947-d8db-42f1-95de-cee06977936c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.581211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d947-d8db-42f1-95de-cee06977936c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.581486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315d947-d8db-42f1-95de-cee06977936c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.583145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 240/483] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:46.588523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.588813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.589092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.609737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:46.610718 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.611003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.611301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.614218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:46.615512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:46.622037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:46.629662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:46.630559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:46.631510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 244/484] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:46.644274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:46.685536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 241/485] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:46.721847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:46.837463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7de4e7-2c5e-4890-8609-928f850609ac None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:46.849257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caec81e-1e70-4341-84ac-fd92eedbcf78 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:46.887315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:46.888130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.888412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.888688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.900788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:46.910373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:46.911286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:46.912648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 242/486] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:46.917115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:46.930200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:46.930879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:46.931160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:46.931461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:46.932223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:46.932529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:46.934728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:46.952045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 245/487] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:46.958651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.087091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c9923-63b5-4013-a2c7-842d72c40e05 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.129305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.129897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.130174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.130443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.131197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:47.131525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.132901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.146868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 243/488] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:47.153159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.187646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c81e1b-178d-408d-8a70-22fc68a46a4c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.225162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.226850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.227470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.227972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.240972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.242779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-37cd5c3b-2ef5-42cb-a72c-072ebc88e6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:47.260556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:47.261473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:47.262334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:47.262334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:47.262334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:47.262334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:47.262550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e7b74-b3f2-4698-94b4-a47a0dedc5af None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.269626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 246/489] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:47.271331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fcf6-8bde-419c-9615-265bb0c2e26d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.271826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fcf6-8bde-419c-9615-265bb0c2e26d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.272316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fcf6-8bde-419c-9615-265bb0c2e26d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.278461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 247/490] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:47.279508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274fcf6-8bde-419c-9615-265bb0c2e26d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.297746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.298547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.298830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.299110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.310803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.312303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ef34165e-81c4-431a-aae4-9e177c69f22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:47.330628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:47.331606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:47.332868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:47.332868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:47.332868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:47.332868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:47.332868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 244/491] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:47.333531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.333907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.334099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.357771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:47.359006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:47.397093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274fcf6-8bde-419c-9615-265bb0c2e26d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.435280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 245/492] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:47.435280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.442422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.449460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.449460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.449460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.449460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:47.449460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.449460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c52280-10b9-4358-a32c-2eecd780d593 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.461389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:47.462694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d851-0036-4583-b8b6-fc70f3da27e9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.462986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d851-0036-4583-b8b6-fc70f3da27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.463294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d851-0036-4583-b8b6-fc70f3da27e9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.469359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 249/494] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:47.469359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632d851-0036-4583-b8b6-fc70f3da27e9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.544523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b085585-2a45-4893-9723-9b918db7fb96 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.573396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632d851-0036-4583-b8b6-fc70f3da27e9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.577817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.578470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.578748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.579020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.579761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:47.580063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.581412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.592944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 246/495] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:47.594824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.607074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f4896-4170-4293-842b-8cede298b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.607965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f4896-4170-4293-842b-8cede298b8ea None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.608198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f4896-4170-4293-842b-8cede298b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.608496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f4896-4170-4293-842b-8cede298b8ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.618216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f4896-4170-4293-842b-8cede298b8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-836f4896-4170-4293-842b-8cede298b8ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:47.625842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:47.626733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:47.627650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 250/496] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:47.628313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ca5e-08a8-454b-a352-310adfd0c952 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.628604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ca5e-08a8-454b-a352-310adfd0c952 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.628804 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ca5e-08a8-454b-a352-310adfd0c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.645692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c0b4ca5e-08a8-454b-a352-310adfd0c952 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:47.646874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c0b4ca5e-08a8-454b-a352-310adfd0c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:47.691461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbacce7-6596-4336-b32a-5ead6baeac8c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.710789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 251/497] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:47.712187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8bc25-54df-4651-a09c-8649fc18d2df None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.712484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8bc25-54df-4651-a09c-8649fc18d2df None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.712762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8bc25-54df-4651-a09c-8649fc18d2df None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.714010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 252/498] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:47.715415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8bc25-54df-4651-a09c-8649fc18d2df None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.728972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.728972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.728972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.728972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.736761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.738197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:47.753259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:47.754170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:47.755087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 247/499] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:47.755714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.818302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8bc25-54df-4651-a09c-8649fc18d2df None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.849647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f940-710e-438e-84b5-4b95cd0fc022 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:47.861476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.862261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.862543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.862815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.869741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.871898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.881784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:47.882434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.882714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.882987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.883749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:47.884052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:47.885394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-51c03172-fd09-451d-bb0e-c93249a577fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:47.887922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:47.888807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:47.889730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 253/500] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:47.890288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:47.890681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:47.890854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:47.899846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 248/501] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:47.900710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.908425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:47.909598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:47.972676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 254/502] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:47.973420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:47.996668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab58b8-6c5d-4e17-b117-f506f6a76493 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.029563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.030348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.030639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.030910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.040662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:48.048429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:48.049292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 249/503] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:48.050476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.069333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f694a3-2ace-43f9-883e-ed0e4b31924c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.101674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.102335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.102620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.102898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.103761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:48.104072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.105534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.141780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 255/504] 10.222.0.42 () {56 vars in 1137 bytes} [Tue May 3 16:08:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:48.142413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.152898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63735add-0454-4cac-b469-9a3065ccb9cf None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.185390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.186053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.186332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.186606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.187458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:48.187771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.189218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.224803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 250/505] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:48.225547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.237692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25936-7735-46dd-9990-e565e563b5d2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.270556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.271371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.271680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.271960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.282274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.283770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:48.301304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:48.302160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:48.303007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:48.303007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:48.303007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:48.303007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:48.303007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 256/506] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:48.303710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.322570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474401-1e92-42b2-9cf7-9b3c1eee3a6b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.355998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.357331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.357691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.357972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.367726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.369176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:48.386659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:48.387720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:48.388599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:48.388599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:48.388599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:48.388599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:48.388599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 251/507] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:48.388880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.402963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1209a4-ef20-46a0-a746-38ca922bbf17 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.435928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.436593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.436873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.437156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.446466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:48.446466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.446466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.447173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 257/508] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:48.447999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.491440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daab70-321f-4520-a51e-c4afcd9766c2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.523988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.524640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.524924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.525205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.546609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630af1b8-3c80-49e8-aeb8-b254125e8288 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.578348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.578987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.579291 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.579568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.590753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.592266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.642176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.643906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.685636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 252/509] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:48.686463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.739209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 258/510] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:48.740067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.780709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed3bb-b991-4497-8607-1d7f0c8b3a95 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.813758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.814410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.814692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.814970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.815706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:48.816011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.817384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.828604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 253/511] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:48.829378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.835491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711f2c6-6273-4bf9-8558-b3bd5194c39b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.868130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.868779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.869061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.869332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.870035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:48.870341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.871807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.882485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 259/512] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:48.883279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:48.934908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77200bfd-eb9a-4956-9a2d-ad13d818dca4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.967298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:48.968086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:48.968384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:48.968656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:48.978780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:48.979890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf0e5-af3c-45c8-bda9-3f7cd303e8f6 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:48.980795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:48.997723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:48.998574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:48.999451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:48.999451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:48.999451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:48.999451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:48.999451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 254/513] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:48.999753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.016034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.016896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.017176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.017764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.029175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.030632 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:49.047679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:49.048677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:49.049707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:49.049707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:49.049707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:49.049707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:49.049707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 260/514] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:49.049707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.096227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256838-dcf8-48e0-bd11-44d9d96058aa None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.127208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.128015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.128292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.128562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.139021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.140479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.144963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13edce3-8d04-4250-81fe-f9394e2bfb74 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:49.157853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:49.158859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:49.159997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:49.159997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:49.159997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:49.159997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:49.159997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 255/515] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:49.159997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.179689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.180472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.180750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.181021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.188290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.189725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:49.205501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:49.206440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:08:49.207392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:49.211315 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 261/516] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:49.212108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.256352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c958-c885-40f4-a638-09c902373a32 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.290280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.290947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.291240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.291535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.292225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.293678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.317985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813908e-82b7-464e-8716-e89ed384afb3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.348623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.349283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.349562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.349838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.350545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:49.350848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.352253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.364037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 262/517] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:49.364874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.423725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 256/518] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:08:49 2022] POST /identity/v3/users => generated 247 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:08:49.424870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.473838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf8f9-0540-4522-96fe-4d0aa0014218 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.518778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.519497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.519802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.520065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.520795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:49.521107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.522506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.539477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 263/519] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:49.539477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.557668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4f030-02c8-42e0-8b4f-c0c4d6fbd5f6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.593836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.594521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.594809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.595085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.595849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:49.596155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.597561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.610190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 257/520] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:49.615476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.656967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee97e2-521f-4bc7-8a23-7049b896c0e0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.692555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.693240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.693557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.693838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.694755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:49.695065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.696548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.713698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d142e6-39cd-4c38-8543-fddc77236cee None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.718829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 264/521] 10.222.0.42 () {56 vars in 1137 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:49.718829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.748994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.750165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.750674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.751152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.758669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.760345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:49.777695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:49.778903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 16:08:49.779925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:49.780609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 258/522] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:49.781330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.819506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ebe00-9c24-47b4-b67e-de60528d842d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.853904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.854612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.855558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.855925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.862543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.864024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:49.878602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:49.879531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:49.880636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:49.884287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 265/523] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:49.885086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.888924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4ba72-d494-4f9a-82da-e94d3893917a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:49.927057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:49.928043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:49.928426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:49.929120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:49.938525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:49.940523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:49.955572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:49.956597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:49.957487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 259/524] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:49.958679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:49.990621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae57ed-a0ac-4560-8ddd-f975b9af03d7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.025625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.026279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.027165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.027475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.061398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022accc2-23e9-4056-a6a2-4e49ca40d8aa None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.094432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.096047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.100371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.101114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.101472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.101821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.102742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:50.103123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.105728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.131596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 260/525] 10.222.0.42 () {56 vars in 1139 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:50.131596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.194076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 266/526] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:50.195012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.235515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ff007-07d5-4144-9c10-a983d730e06f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.269153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.269826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.270111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.270388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.271171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:50.271524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.273047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.290929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 261/527] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:50.291787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.292190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e8e7-d9db-40e6-a920-a140edf28a6f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.327476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.328145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.328397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.328671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.329447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:50.329751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.331174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.348909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 267/528] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:50.349729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.398812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543296-5120-4c61-ac36-9b913b6351af None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.433648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.434392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.434679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.434957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.451666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178280-bab9-4cf0-b3a5-61dd07e2471f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.486310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.487111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.487425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.487707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.498784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.501064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.506695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.508320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:50.520783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:50.521647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:50.522620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:50.522620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:50.522620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:50.522620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:50.522620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 268/529] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:50.522904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.621200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 262/530] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:50.622157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.627170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213313b-eb84-44f1-8fa4-ed806410ba84 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.662084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.662819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.663212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.663540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.664364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=0545d7ffc7b84827a5f64629b0e447f0) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:50.664678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.666108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.679658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 269/531] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/role_assignments?user.id=0545d7ffc7b84827a5f64629b0e447f0&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:50.679658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.747167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c908-2aaf-49c0-8f53-7ac095f2ebb2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.790745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.791930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.793096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.793718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.794671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=7bc226da24944f578dd20785b5bcece6) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:50.794781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea4ba-e489-46b8-b178-4da3cd684f9e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:50.795161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.798016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.807428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 263/532] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/role_assignments?user.id=7bc226da24944f578dd20785b5bcece6&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:50.808962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:50.864761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:50.865443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:50.865728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:50.866007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:50.866780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:50.867100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:50.868527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:50.892691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 270/533] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:50.900472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.011983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609f1c-beec-47f6-9c02-5335cf7db6a2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.056847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.057641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.058031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.058333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.070081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.071563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.077625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9af69-534e-4232-9b32-513a93710aac None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:51.091296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:51.092192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:51.093507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:51.093507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:51.093507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:51.093507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:51.093507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 264/534] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:51.097922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.124211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.125029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.125311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.125585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.138822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.140310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:51.175727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:51.176731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:51.178620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 271/535] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:51.185362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.230977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91afc4f-1021-4e62-bc8a-d19eb3808e94 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.285520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.286200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.286486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.286764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.287512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:51.287818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.289210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.301447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 265/536] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:51.312276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.342610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0def6e-a3f8-4511-a40b-0a9aa8e76b06 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.389345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.390023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.390314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.390597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.391716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:51.391716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.393417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.415435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 272/537] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:51.422988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5201f-0480-4fba-a11b-8a266dc5e3a7 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.426151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.462296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.463845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.464890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.465366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.485233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.486689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:51.515339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:51.516260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:51.517113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:51.519421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 266/538] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:51.527275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.608551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a725d-a268-4fb2-9b82-e00a2ded0114 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.689795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.690462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.690751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.691032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.699418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=6d24cf5fddb64b1096184a842975ae3e) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:51.699418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.699418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.700023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 273/539] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:51 2022] GET /identity/v3/role_assignments?user.id=6d24cf5fddb64b1096184a842975ae3e&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:51.711842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d7cc-babc-474a-aa44-aae659e31a9d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:51.749820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:51.750812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.751346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.751826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.752857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:51.753369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:51.755126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afa4e8-b6fd-454f-8abe-c01b3e18290f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:51.769022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 267/540] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:51.774675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:51.889071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227ef0-15b1-4538-88a6-9c87274286c9 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.889718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227ef0-15b1-4538-88a6-9c87274286c9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.890342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227ef0-15b1-4538-88a6-9c87274286c9 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.892880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 268/541] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:51.905342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:51.905969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:51.906470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:51.940089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:51.941328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:51.958814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a15edc-cace-40d3-95c1-65f57f470c7c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:52.018207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:52.018885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:52.019170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:52.019480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:52.020323 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=79eb9c30fbae438784968a8f770a92f7) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:52.020638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:52.022117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:52.035619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 274/542] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:51 2022] GET /identity/v3/role_assignments?user.id=79eb9c30fbae438784968a8f770a92f7&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:52.071604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 269/543] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:52.107744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:52.229867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64bcb6-7a4a-41e6-9640-0ae5db2537fc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:52.276080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:52.277867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:52.278375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:52.278702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:52.291948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:52.300033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:52.300977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:52.301768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 275/544] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:52.309130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:52.412730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f4e27-e4d3-464b-b2fd-c846cef0af4d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:52.446756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:52.447751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:52.448282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:52.460281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:52.460281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:52.460281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:52.460281 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:52.460807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 270/545] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:52.466394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:52.592076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f734853-8f7e-4898-b207-08d95c7d4d7a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:52.632908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:52.634044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:52.634477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:52.634897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:52.646745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:52.648428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:52.673910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:52.675112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:52.676209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:52.676209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:52.676209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:52.676209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:52.678087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 276/546] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:52.686239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:52.813652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b2784-15d2-4282-944d-28185ad7a212 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:52.852016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:52.852735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:52.853024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:52.853301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:52.854022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:52.854325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:52.855935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:52.872262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 271/547] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:52.877898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.032251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4693-4434-4b27-b944-5116ea753f06 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.076526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.077255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.077539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.077814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.085803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:53.087265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:53.101902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:53.102853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:53.103793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 277/548] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:53.109355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.247037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f47bf-d37f-4f31-8ede-d16f5a041a59 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.286373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.287096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.287406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.287683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.288517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:53.288823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:53.290267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98cd9b-e288-4876-870d-85b727fdd881 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:53.315190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 272/549] 10.222.0.42 () {56 vars in 1135 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:53.320567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.383301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dacf2-add9-4548-82ad-156b3bf3e6e8 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.383951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dacf2-add9-4548-82ad-156b3bf3e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.383951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dacf2-add9-4548-82ad-156b3bf3e6e8 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.386039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 273/550] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:08:53.391353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4eb5-0b79-4d9f-8f28-1462a45002d6 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.391910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4eb5-0b79-4d9f-8f28-1462a45002d6 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.392631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4eb5-0b79-4d9f-8f28-1462a45002d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.424339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7daa4eb5-0b79-4d9f-8f28-1462a45002d6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:53.425969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7daa4eb5-0b79-4d9f-8f28-1462a45002d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:53.439647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f8e53-1a76-4dd7-85bf-0d66733ca12a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.475164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.475164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.475164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.475164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.542673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:53.544278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:53.556058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 274/551] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:53.557448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37d55-23df-4282-aa5d-0298a0511fe7 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.557757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37d55-23df-4282-aa5d-0298a0511fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.558036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37d55-23df-4282-aa5d-0298a0511fe7 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.567632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 275/552] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:53.572963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.573786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.574187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.601023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:53.602207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:53.649198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 278/553] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:08:53.650046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.671234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 276/554] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:53.672205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.754214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6afce-89e1-475a-9895-18b5da2509d5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.774884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173022e-963f-4aa7-a706-22085d10fb1a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.788727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.789523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.789808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.790087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.801059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:53.810002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:53.812046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:53.813488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:53.814247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.814247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.814420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 279/555] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:53.814420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.819272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.819272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.829021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:53.831232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:53.855377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:53.857474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:53.859359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:53.859359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:53.859359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:53.859359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:53.859359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 277/556] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:53.859359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.928533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa094e-76f3-4512-b028-11f15d061f33 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.961731 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6eb56-5b85-47de-93e7-e825b52ad570 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:53.965141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.965948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.966229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.966497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.977273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:53.985293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:53.987247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 280/557] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:53.989132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:53.997512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:53.998191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:53.998475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:53.998754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:53.999534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:53.999842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.001305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.009994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 278/558] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.016729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.096814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e5f2c-d18f-42b1-bbb2-9def56a4f636 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.122582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3024c79-7e5e-4984-af93-2959571346b9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.136303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.137139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.137425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.137705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.138483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:54.138894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.140459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.154862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 281/559] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.156112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.159027 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.159986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.160264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.160535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.161285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:54.161593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.162989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.173039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 279/560] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.173938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.268297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1771b-361e-482f-82de-3ec13ef578ed None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.281086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab77b0-a2c8-47a9-b1c0-ff6f15a46516 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.304019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.304888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.305180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.305457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.317417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.317762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.318674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.318959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.319118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.319293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.328024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.329667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:54.339393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:54.341380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:54.343894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:54.343894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:54.343894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:54.343894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:54.343894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 282/561] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:54.343894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:54.350408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:54.352615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 280/562] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:54.355123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.449763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1771d6-1253-4f20-9657-aed36c4c176d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.488744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cc78c-9bfb-4157-ae35-60e21d457013 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.492130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.493072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.493353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.493622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.512806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.514623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:54.533469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:54.534531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:54.535796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:54.535796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:54.535796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:54.535796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:54.535796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 283/563] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:54.535796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.543378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.544316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.544824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.545305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.546192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:54.546670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.548240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee92d56-5aa3-42b5-8836-73b0279c4c04 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.563196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 281/564] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.565346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa182-dfe6-49b4-8e42-957e852b2aa3 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.565797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa182-dfe6-49b4-8e42-957e852b2aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.566359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa182-dfe6-49b4-8e42-957e852b2aa3 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.568341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 282/565] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:54.569215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa182-dfe6-49b4-8e42-957e852b2aa3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.637324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5083ee-1cde-4a7b-afba-1a9fc0b6bb58 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.670418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.671078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.671393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.671674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.672455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:54.672770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.674197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.679199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fa182-dfe6-49b4-8e42-957e852b2aa3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.686664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 284/566] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.687295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.719131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.719855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.720135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.720409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.721136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:54.721440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.722858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d3d36-7f15-4564-a51a-de86bcc1af86 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.737446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 283/567] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.739662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.740601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.741145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.760290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:54.761815 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:54.791900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fafc94-bc1f-4e03-94fa-bb1136b16ec0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.825113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.825906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.826193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.826474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.835478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 284/568] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:54.835478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.846479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.848061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:54.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:54.864086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:08:54.865313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:54.868946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 285/569] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:54.869684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:54.933076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e43cb-a05d-4eb9-b244-15d79e1106fc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.966302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:54.966955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:54.967241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:54.967547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:54.968369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=9ccd3c2454f94e998769076fbe20eb15) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:54.968570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fe2ec-c769-4fc7-aec8-ecc146f6e2d6 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:54.968685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:54.970101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:54.975358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 285/570] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/role_assignments?user.id=9ccd3c2454f94e998769076fbe20eb15&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:54.976132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.008183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.009022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.009302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.009576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.018897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.020420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:55.036034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:55.037051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 286/571] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:55.038489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.089394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b363d6a-95d1-44ec-88f8-113ce791d56f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.128112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf97410-aaab-4f81-9523-3503d23f14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.128930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf97410-aaab-4f81-9523-3503d23f14c5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.129214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf97410-aaab-4f81-9523-3503d23f14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.129491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf97410-aaab-4f81-9523-3503d23f14c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.142103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf97410-aaab-4f81-9523-3503d23f14c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-0bf97410-aaab-4f81-9523-3503d23f14c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:55.150155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:55.151446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:55.152291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 286/572] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:55.153150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8436238-5ad1-40e5-836f-acfa98361712 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.153150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8436238-5ad1-40e5-836f-acfa98361712 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.153338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8436238-5ad1-40e5-836f-acfa98361712 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.154791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 287/573] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:55.157300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8436238-5ad1-40e5-836f-acfa98361712 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.161734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27d3f-cdc1-4aa0-9528-a2008c91bffd None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.196773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.197551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.197834 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.198112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.198989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:55.199351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.200799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.219248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 287/574] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:55.220393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.266685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8436238-5ad1-40e5-836f-acfa98361712 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.303772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.304450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.304734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.305019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.305856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:55.306426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.307688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac15dcb-4f0a-4656-b670-a78dd168e2e3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.318591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f48708-1eb8-498b-bbf4-162d5546b4ec None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.330000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 288/575] 10.222.0.42 () {56 vars in 1137 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:55.330000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.330000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.330000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.345527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:55.346754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:55.359006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.359707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.360019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.360265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.361009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:55.361318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.362692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.370888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 288/576] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:55.372878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.423276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 289/577] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:55.423276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.471706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fc3e7-fb7d-418f-8706-2bebf3e48ef3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.524575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d5696-90d8-4336-bdda-8127fdacfa05 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.527498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.528302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.528585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.528858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.539512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.540955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:55.558451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:55.559389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:55.560281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:55.560281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:55.560281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:55.560281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:55.560281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 289/578] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:55.560560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.561775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.562561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.562842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.563113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.573877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.575464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:55.593662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:55.594555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:55.595462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:55.595462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:55.595462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:55.595462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:55.595462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 290/579] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:55.596249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.666605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567bdc-6fc6-48c3-9923-fc6bed054196 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.700874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123550-b6e7-4e66-b644-c45f3e38e80c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.704451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.705251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.705535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.705814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.717193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.718643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.735489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:55.736050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:55.736909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:55.737827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:55.737827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:55.737827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:55.737827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:55.738045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.738045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.738045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.738234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 290/580] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:55.738790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.751802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:55.759564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:55.760474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 291/581] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:55.767615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.842113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ec94-5a14-4dab-b766-52aadb35c151 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.866898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60911-13ec-494f-a802-1608f0cda616 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:55.878357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.879021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.879334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.879785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.880511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:55.880846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.882218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.895122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 291/582] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:55.896191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.905206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:55.905868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:55.906150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:55.906427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:55.907154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:55.907492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:55.908929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:55.920885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 292/583] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:55.921702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:55.999620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71080ab9-e465-43b2-bef9-4e4d14ad220e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.025727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1409-adb8-4beb-b3bf-ead4daccfe47 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.045346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.046611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.046911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.047177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.047983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:56.048339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.050550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.064088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.064758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.069623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.069766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 292/584] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:56.069857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.069939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.070019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:56.070019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.070019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.077200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 293/585] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:56.082148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.173970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97de122-b1d9-47c5-bc90-94413213e661 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.195788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe206-6de8-4189-bc64-06733f503858 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.212737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.213820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.214110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.214393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.221142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.222582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.229773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.230642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.230921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.231187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:56.236534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:56.237487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 293/586] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:56.238997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.241391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.242947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:56.258648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:56.259618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:56.260531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:56.265053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 294/587] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:56.265910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.338448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad4fa5-d0c7-4b02-83be-b4fdc3bfbe15 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.363625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535283c-a0a7-47b7-a086-5f24b2021d41 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.372426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.373508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.373794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.374076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.381295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.382877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.398007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:56.398177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:56.399102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:08:56.400106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:56.400684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.400684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.400684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.400887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 294/588] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:56.400887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.413937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.415415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:56.433941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:56.435885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:56.436773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:56.436773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:56.436773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:56.436773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:56.436773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 295/589] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:56.436773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.498819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba85f4f-44d2-4ed8-8af7-e8b52595adc0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.532379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.533093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.533324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.533599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.533843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b6092-bbf2-4250-b219-036dea245322 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.534379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:56.534684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.536249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.548331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 295/590] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:56.549435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.568266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426462f9-73fe-49e9-81df-67647338255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.568929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426462f9-73fe-49e9-81df-67647338255d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.569211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426462f9-73fe-49e9-81df-67647338255d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.569486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426462f9-73fe-49e9-81df-67647338255d None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.570257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426462f9-73fe-49e9-81df-67647338255d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:56.570566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426462f9-73fe-49e9-81df-67647338255d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.572020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426462f9-73fe-49e9-81df-67647338255d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.588332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 296/591] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:56.588332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426462f9-73fe-49e9-81df-67647338255d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.647071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176ed1b-85e9-4165-b50c-432ea4223a84 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.682022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.683407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.683910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.684246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.685038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:56.685195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426462f9-73fe-49e9-81df-67647338255d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.685371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.686781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.709252 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 296/592] 10.222.0.42 () {56 vars in 1137 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:56.709252 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.717703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.718372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.718653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.718929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.719671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:56.719981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.721352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.734092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 297/593] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:56.734944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:56.812955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730e57-2e1c-4eaa-b084-b3a2af94dfcc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.829765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbbd4f-e447-4248-b82e-0aacd9458332 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:56.846258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.847148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.847458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.847733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/7bc226da24944f578dd20785b5bcece6/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.863275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:56.863577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=7bc226da24944f578dd20785b5bcece6, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.864305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:56.864647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:56.864829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.865030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/0545d7ffc7b84827a5f64629b0e447f0/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:56.880373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=0545d7ffc7b84827a5f64629b0e447f0, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:56.887237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:56.999604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 297/594] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:56 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/7bc226da24944f578dd20785b5bcece6/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:57.000352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.047859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 298/595] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:56 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/0545d7ffc7b84827a5f64629b0e447f0/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:57.047859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.219594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf325-ec65-4f4a-8fcb-46bb827138b3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.265455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe924e-b8ee-45a8-86d8-65fb2bbe31d9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.270782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.272055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.272603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.273101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.288704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.290966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.302344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.303150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.303543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.303879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.311543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.313062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-50261949-35a5-4885-a560-7ab861f9729d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:57.313845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:57.314748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:57.315672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:57.315672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:57.315672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:57.315672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:57.318786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 298/596] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:57.318786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9fd6a-b7ca-4137-8363-c0c568c258f0 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.318786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9fd6a-b7ca-4137-8363-c0c568c258f0 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.318786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9fd6a-b7ca-4137-8363-c0c568c258f0 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.320118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 299/597] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:57.322846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9fd6a-b7ca-4137-8363-c0c568c258f0 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-bfe49718-f617-42a8-a147-c143bc5a3d0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:57.332370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:57.333322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 299/598] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.335868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.337635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.356329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:57.357538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:57.427773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 300/599] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:08:57.428699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.436622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9fd6a-b7ca-4137-8363-c0c568c258f0 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.472964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.473631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.473916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.474193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.474956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:57.475274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.476827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.490393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 300/600] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:08:57.491278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.531704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371512-cb3b-49aa-9573-1a346516b078 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.567816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.568498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.568780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.569057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.569897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:57.570205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.571687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.589857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 301/601] 10.222.0.42 () {56 vars in 1139 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:57.590698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.601085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb833e4-6908-4612-927a-3e48dd30c7e2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.637256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.638110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.638541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.638827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.650169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:57.658881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:57.661115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 301/602] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:57.663180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.689650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf66f63-9c44-4598-9c37-824390e59597 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.723884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.724678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.724963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.725239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.732687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.734143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:57.748072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:57.750145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 302/603] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:57.752380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.766848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fd7e5-f8fb-4988-ae97-538f33f1acff None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.802750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.803592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.803878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.804152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.815521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.817085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:57.834919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:57.836991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:57.839753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:57.839753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:57.839753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:57.839753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:57.844100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 302/604] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:57.844100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.851604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c75ecd-d22f-4d1e-af60-c7f5ecd3caf6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.896995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.897744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.897991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.898437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.899595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:57.900047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.902917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:57.913614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 303/605] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:57.914883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:57.956466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5daff-dc36-49ec-99fb-739f0c718590 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:57.991270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:57.991945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:57.992224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:57.992491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:57.993281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:57.993588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:57.995635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.011583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 303/606] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:58.012488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.033521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08ed0-f565-4508-800d-667c34532b32 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.077190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.078093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.078375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.078786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.079691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:58.079995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.081810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.096871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 304/607] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:58.098084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.121487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019012-1707-4bd2-b12a-ff663f35f0df None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.156758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.158167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.158575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.158959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.172906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.174674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:58.199068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:58.200226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:58.201348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:58.201348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:58.201348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:58.201348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:58.201348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 304/608] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:58.202409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.222909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd384-6391-47aa-a19c-d29f02f78f03 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.268218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.269718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.270347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.270722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/6d24cf5fddb64b1096184a842975ae3e/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.289907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=6d24cf5fddb64b1096184a842975ae3e, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.291395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.312920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615ff8-7216-40b1-ada2-31c95766fc65 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.348519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.349392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.349789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.350206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.357472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.359062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:58.373260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:58.379977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 305/609] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:58.380910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.415397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 305/610] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:58 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/6d24cf5fddb64b1096184a842975ae3e/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:08:58.416725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.491385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d1701-e803-408e-aee3-e363047d55c4 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.537992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.541490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.541490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.541490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.541490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:58.541490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.545779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.577125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 306/611] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:58.584963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.621897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed75b9-9b37-4549-bf0c-99a4284c096b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.688375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.689091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.689337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.689694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.690424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:58.690738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.692222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.705652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 306/612] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:58.711407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.729994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963ad8f-0c45-4978-b9ae-3208faff44ef None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.766902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469066-d235-4234-a209-ab908d029581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.768247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469066-d235-4234-a209-ab908d029581 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.768673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469066-d235-4234-a209-ab908d029581 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.769086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469066-d235-4234-a209-ab908d029581 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.777186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469066-d235-4234-a209-ab908d029581 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.778967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469066-d235-4234-a209-ab908d029581 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-43469066-d235-4234-a209-ab908d029581 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:08:58.794090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:58.795293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 16:08:58.796431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:08:58.798544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 307/613] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:58.804167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469066-d235-4234-a209-ab908d029581 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:58.817129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf224e-fbd5-4824-a86b-3eeab567d113 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.852877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.853777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.854088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.854940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/79eb9c30fbae438784968a8f770a92f7/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.870691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=79eb9c30fbae438784968a8f770a92f7, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.872240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.913908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469066-d235-4234-a209-ab908d029581 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:58.950899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:58.951665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:58.951955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:58.952237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:58.953075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:58.953389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:58.954811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:58.965658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 307/614] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:08:58 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/79eb9c30fbae438784968a8f770a92f7/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:08:58.986791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 308/615] 10.222.0.42 () {56 vars in 1135 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:58.992992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.122836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d05cc-9df2-494a-80d3-35757ddd37aa None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:59.172977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:59.173887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.174175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.174500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.189000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:59.190620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:08:59.212597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:59.213546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:59.214956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:08:59.214956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:08:59.214956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:08:59.214956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:59.214956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 308/616] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:59.221403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.345023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200ff0d-e7c5-4937-bcc7-a5bb82b390e6 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:59.383147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:59.383776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.384060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.384339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.385075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:59.385382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:59.387423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4c3eb-a9fb-4fd5-ade3-491b9afafc41 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:59.401220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 309/617] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:59.406636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.447208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211439c4-ae5d-4830-8bd3-ddd89b0c5562 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.447528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211439c4-ae5d-4830-8bd3-ddd89b0c5562 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.447814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211439c4-ae5d-4830-8bd3-ddd89b0c5562 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.449489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 310/618] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:59.454610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8fa4-745e-49dd-95e6-c552c43be5de None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.454896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8fa4-745e-49dd-95e6-c552c43be5de None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.455175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd8fa4-745e-49dd-95e6-c552c43be5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.474180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f5cd8fa4-745e-49dd-95e6-c552c43be5de None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:59.476180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f5cd8fa4-745e-49dd-95e6-c552c43be5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:59.527353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b23f0-2589-4e36-ba37-1f7a808d9a27 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:59.596545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:59.597584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.598006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.598420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.603320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 311/619] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:59.605008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4292824-cad2-4041-a718-45a565a04abd None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.607592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4292824-cad2-4041-a718-45a565a04abd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.610798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4292824-cad2-4041-a718-45a565a04abd None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.612312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 312/620] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:08:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:08:59.614137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:59.615801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:59.623281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.623281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.623281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.639681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:08:59.640927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:08:59.641162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:59.642288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:08:59.643194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:59.646361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:08:59.647313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.723524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 313/622] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:08:59.724598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.772296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4ecf-75e4-4317-b8a2-451ff244c313 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:59.810333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:59.811300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.811724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.812052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.822371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:08:59.830933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:08:59.832169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:08:59.833193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:08:59.840020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 310/623] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:08:59.840996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.849139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13a8a7-2fd7-43ac-bb79-e7194a989ef1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:59.893499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:59.894384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.894811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.895247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:08:59.896626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:08:59.897080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:08:59.899069 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:08:59.919940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 314/624] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:08:59.921148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:08:59.952181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb63d9-c67a-4217-9903-56fe4c74078f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:08:59.986210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:08:59.987168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:08:59.987590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:08:59.987985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.002826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:00.011893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:00.013078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:00.014054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:00.020951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 311/625] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:08:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:00.021917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.054163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b674c1-2264-4731-89af-bab692e287bc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.090297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.091045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.091463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.091849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.092708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:00.093172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.094624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.111280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 315/626] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:08:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:00.111280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.137916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325233-9e83-40f6-acb0-88e0d071981c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.172660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.173641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.174031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.174428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/9ccd3c2454f94e998769076fbe20eb15/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.190481 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=9ccd3c2454f94e998769076fbe20eb15, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.192871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.208546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e5e1-0314-4a7b-93cd-6100a35f5dc0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.240639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.241304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.241601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.241899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.242632 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:00.242930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.244339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.257348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 316/627] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:00.257348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.268586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 312/628] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:00 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/9ccd3c2454f94e998769076fbe20eb15/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:00.269989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.398955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d3a5-46ea-46cd-8b6c-53add2811785 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.440695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.441738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.442183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.442621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.457650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.460177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.473566 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105c2c3-e0dc-4671-a2e7-4073a3db20d1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:00.484126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:00.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:00.492415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:00.492415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:00.492415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:00.492415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:00.493180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 313/629] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:00.495457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.601197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.602113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.602523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.602854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.613852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f9d8-42ef-458f-a72a-183711f8afb6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.615130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.617387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:00.635080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:00.636915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:00.638046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:00.638046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:00.638046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:00.638046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:00.639708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 317/630] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:00.653942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.660860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.661751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.662215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.662692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.663676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:00.664579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.666126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.682078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 314/631] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:00.688316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.831626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f420027-5c0a-40f9-a105-35e7b3aaba2b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.848789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32247c-50c0-41cc-8ed8-ad08485ced4a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:00.895870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.896557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.896851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.897125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.897835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:00.898136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.899511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.911691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:00.912485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:00.912809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:00.913078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:00.926414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:00.927891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:00.929152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 318/632] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:00.940251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:00.949708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:00.950698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 16:09:00.951787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:00.954090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 315/633] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:00.962859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.153689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c5bb-2b9e-4c7c-93a9-08bc7657f5cb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.173016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0f6d7-08b7-41f0-860a-7380475c55d1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.195527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.196679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.197149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.197659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.206741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:01.207064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.207759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.208042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.208318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.209150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:01.209465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:01.209582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:01.210872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5c27-ff08-46e7-88ec-e5faeb832513 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:01.225698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:01.226739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:01.227736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:01.229294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 316/634] 10.222.0.42 () {56 vars in 1137 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:01.234646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d715b3-e335-49ce-b36e-e2dfd4ddd249 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.234646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d715b3-e335-49ce-b36e-e2dfd4ddd249 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.234646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d715b3-e335-49ce-b36e-e2dfd4ddd249 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.235197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 319/636] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:01.236271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.236715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 317/636] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:01.238424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.238731 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.239014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.255677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:01.256860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:01.331357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 318/637] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:01.332309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.349371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ed5b-37d6-4f26-9f34-01d4020ed9f5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.387002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.387722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.388007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.388286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.444050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc161401-58b5-42c7-b9a2-3caead295ad9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.461603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:01.462703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:01.485521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.486684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.487122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.487621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.488607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:01.489099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:01.490705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:01.509548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 319/638] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:01.510775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.581745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 320/639] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:01.582767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.613099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5a26e-5e4f-4c5a-9722-0bcab4feb92b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.648722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.649818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.650311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.650786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.664403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:01.674933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:01.676046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:01.677093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:01.679204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 320/640] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:01.680137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.691563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a59fb-7a10-4d58-81d6-9076025c6639 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.726552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.727138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.727458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.727741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.783918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08405b6-ef6f-45f7-a640-689fc31ab566 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:01.795964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:01.797431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:01.817093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:01.817947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.818235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.818565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.829515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:01.830956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-7448cb2d-6384-4b1a-87a7-e2b989e74f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:01.848177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:01.849151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:01.850137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:01.850137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:01.850137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:01.850137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:01.850137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 321/641] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:01.850931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620138-3517-49dc-a130-7aaba80a2bb1 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:01.850931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620138-3517-49dc-a130-7aaba80a2bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:01.851065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30620138-3517-49dc-a130-7aaba80a2bb1 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:01.852503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 322/642] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:01.854879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620138-3517-49dc-a130-7aaba80a2bb1 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.903172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 321/643] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:01.904857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:01.968379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30620138-3517-49dc-a130-7aaba80a2bb1 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.002166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.002752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.003036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.003336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.004076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:02.004379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.005766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fba44-548e-4e76-b0e4-aebc9c97d77d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.010001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3e9f1-a271-46f0-9f28-c510841c0811 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.018133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 323/644] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:02.018133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb353-b431-4675-b51d-794d4026a83f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.018133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb353-b431-4675-b51d-794d4026a83f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.018133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb353-b431-4675-b51d-794d4026a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.033726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-91efb353-b431-4675-b51d-794d4026a83f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:02.034901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-91efb353-b431-4675-b51d-794d4026a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:02.048269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.048939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.049227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.049507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.050228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:02.050537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.051936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.063697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 322/645] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:02.064510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.123282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 324/646] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:02.123282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb353-b431-4675-b51d-794d4026a83f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.180342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660385e-33b7-42ac-b59a-db040a94ef96 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.208272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb353-b431-4675-b51d-794d4026a83f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.212750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.214063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.214385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.214619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.224994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.226441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.242496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.243308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.243591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.243865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:02.244167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:02.245003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:02.245961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:02.245961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:02.245961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:02.245961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:02.245961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 323/647] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:02.246680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.259899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.261383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:02.279349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:02.280240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:02.281117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:02.281117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:02.281117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:02.281117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:02.281117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 325/648] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:02.281425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.351395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6788a-52c5-4042-9690-3a8615402353 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.378611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3642a7-f06d-47f7-855b-6fcd4b795dcc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.384121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.384915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.385199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.385531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.392589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.394036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:02.408766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:02.409670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:02.410557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 324/649] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:02.411137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.418203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.419004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.419300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.419576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.430153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:02.438133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:02.446779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 326/650] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:02.447670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.519178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54c56a-7e9b-4c05-be10-3ee09b4dc1bc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.548763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb8a1a-71b0-43b7-866a-617648ab382b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.551535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.552196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.552475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.552748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.553457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:02.553759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.555134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.566220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 325/651] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:02.567024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.585059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.585722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.585998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.586314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.587031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:02.587367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.589392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.605594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 327/652] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:02.605594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.669156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b670-ccfd-4f0c-9ed2-2deee612714e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.706114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.706785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.707067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.707376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.708168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:02.708483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.709941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.712747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c9866-dc0b-4f17-93e8-569b1514c209 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.727883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 326/653] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:02.727883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.748774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.749447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.749730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.750007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.750742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:02.751055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.752465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.765579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 328/654] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:02.765579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.833088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e6e9-8124-4f79-b9fb-be55c5ab3a7b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.861759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89526e1-ad2c-4eac-8c65-4eb635619003 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:02.866195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.866992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.867307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.867589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.875084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.876564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:02.890592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:02.891492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 327/655] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:02.897410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.897966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:02.897966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:02.897966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:02.897966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:02.903809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:02.905227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:02.918880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:02.924484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 329/656] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:02.926167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:02.991700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f367df4-324e-4bb0-8234-5bd7b8aab417 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.017394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2bcda-b07c-4aaf-be1a-94b6cd4226eb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.025912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.026639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.026924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.027201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.028113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=0545d7ffc7b84827a5f64629b0e447f0) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:03.028428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.029869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6cf17-80c2-4cff-b218-ecf391680dc8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.035606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 328/657] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/role_assignments?user.id=0545d7ffc7b84827a5f64629b0e447f0&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:03.036829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6469b47-b7fa-49fa-95da-5b17475d5c3d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.037118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6469b47-b7fa-49fa-95da-5b17475d5c3d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.037421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6469b47-b7fa-49fa-95da-5b17475d5c3d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.038628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 329/658] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:03.039403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6469b47-b7fa-49fa-95da-5b17475d5c3d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.066143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.066964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.067265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.067565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.079806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.081266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:03.099330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:03.100439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:03.101381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:03.101381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:03.101381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:03.101381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:03.101381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 330/659] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:03.101661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.165777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6469b47-b7fa-49fa-95da-5b17475d5c3d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.203791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.204858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.205328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.205790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.206781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:03.207100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.208605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f2443-e9c6-4542-9eff-a4ab7f05e5fe None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.209666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008af77-3849-430a-9168-a6eb381fb813 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.223307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 330/660] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:03.223307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.223307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.223641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.241478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:03.242662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:03.247196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.247404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.247593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.247815 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.248647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:03.248956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.250394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.272068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 331/661] 10.222.0.42 () {56 vars in 1137 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:03.272771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.321782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 331/662] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:03.322636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.387086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd662c8-a92c-406f-82f6-d7fa8d5b3edd None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.421689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5e71-a5e1-46fe-8146-7a840f978210 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.422107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.422776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.423061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.423366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.424092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:03.424401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.425776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.437725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 332/663] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:03.441875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.457317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.457667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.457996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.458367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.459049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=7bc226da24944f578dd20785b5bcece6) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:03.459417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.460844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.466988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 332/664] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/role_assignments?user.id=7bc226da24944f578dd20785b5bcece6&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:03.467819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.551697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7749-791c-438a-90d0-08dd07bfb361 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.578326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8dcf3-7a96-4737-8b17-03b5f32a7e1f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.589666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.590775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.591274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.591750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.616412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.616830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.617119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.617398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.629350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:03.637696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:03.638708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 333/665] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:03.644940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.675574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.677362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.754473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad41ab-ab66-4602-9f03-74b45e69fb17 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.779750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 333/666] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:03.781019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.800204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.801385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.801876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.802378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.811241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.813097 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:03.828188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:03.829189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 16:09:03.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:03.832815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 334/667] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:03.833800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.881137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f52fe-e685-47f3-af0f-32a2326efdfe None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.915811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.917082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.917380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.917652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:03.918711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:03.918711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:03.920064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:03.932859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 334/668] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:03.933842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:03.945684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db2db-dd80-4115-96f1-5a5cb87efd3e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:03.988808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:03.989812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:03.990187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:03.990599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.002603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.004260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:04.022340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:04.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:04.024717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:04.024717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:04.024717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:04.024717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:04.026212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 335/669] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:04.027214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.061472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864e6f4-4894-4452-9fb1-72ff1afb2757 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.104912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.105758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.106248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.106671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.107643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:04.108041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.109615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.132976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 335/670] 10.222.0.42 () {56 vars in 1139 bytes} [Tue May 3 16:09:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:04.132976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.145928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97c05-40f6-4225-91ff-4db7eb2702f3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.188171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.189373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.189880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.190360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.202410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.204179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:04.221691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:04.222662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:04.223599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:04.223599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:04.223599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:04.223599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:04.230588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 336/671] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:04.231681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.233728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c960e-e6db-4662-b7b4-bcba5bd5793d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.271509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.272034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.272314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.272642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.273358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:04.273705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.275091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.288349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 336/672] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:04.289265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.340349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d96b8-e56c-4842-9782-765a8fcfb401 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.374968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.376133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.376645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.377129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.390398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec6652-5c48-48ff-b6a6-09b418a98111 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.424828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.425530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.425814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.426086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.426792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:04.427088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.428661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.445678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 337/673] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:04.445678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.456008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.457679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.548269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e0c5-2563-47fa-85db-7ef3d54e628f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.565238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 337/674] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:04.566376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.584377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.585278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.585627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.586039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.593053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.594557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:04.608587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:04.609551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:04.610474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 338/675] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:04.611740 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.674619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa400-f6b7-4469-aedd-8564065fa204 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.710521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.711679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.712178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.712765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.714340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9686c-c67b-45ff-aee9-b6a7b13773bc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.720750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.722480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:04.738271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:04.739359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:04.740371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:04.748076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 338/676] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:04.749634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.751551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.752357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.752683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.752959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.764834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.766075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:04.785991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:04.786959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:04.787988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:04.787988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:04.787988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:04.787988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:04.792602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 339/677] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:04.793103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.859378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce90d6-bc04-4fbe-b62f-8176fc2a34f0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.895078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.896125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.896645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.897128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.898133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:04.898648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.899514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38f60-11f1-4208-b48e-817e6e9e614b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:04.900567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.913140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 339/678] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:04.914294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:04.935111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:04.935646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:04.935964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:04.936237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:04.937060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:04.937362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:04.938829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:04.961115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 340/679] 10.222.0.42 () {56 vars in 1135 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:04.961115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.025680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9853d7-455e-450a-9c7f-cb303b6b5ec0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.061399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.062341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.062474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2971e-f458-410e-bf01-4c6791b870b1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.062903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.063375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.064239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:05.064695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.066229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.079411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 340/680] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:05.080555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.102643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.103684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.104550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.105055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.106029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=6d24cf5fddb64b1096184a842975ae3e) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:05.106484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.108133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.114872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 341/681] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:04 2022] GET /identity/v3/role_assignments?user.id=6d24cf5fddb64b1096184a842975ae3e&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:05.115894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.190687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de242c-af0d-4d34-81f0-a8c530ff6a62 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.224903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ab5d2-2261-4f7a-bb2f-9243807bd859 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.229652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.230691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.231165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.231670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.264913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.265940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.266292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.266906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.274635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.276398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:05.290957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:05.292032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:05.292933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:05.296981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 342/682] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:05.298330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.314919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.316778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.436604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 341/683] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:05.442376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.459737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340b4c3-16e6-4576-a1f3-aec233b14a26 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.503304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.504047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.504337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.504609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.505388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:05.505690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.507135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39816a5f-66da-4d6b-a10d-435f6db4abd0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.521816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 343/684] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:05.523346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce12b9-8825-44aa-8bc8-8b13768d37c9 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.523773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce12b9-8825-44aa-8bc8-8b13768d37c9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.524259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce12b9-8825-44aa-8bc8-8b13768d37c9 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.525886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 344/685] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:05.530665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce12b9-8825-44aa-8bc8-8b13768d37c9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.559174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c6e53-c617-4889-b9b1-a937303e4287 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.602792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.603614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.604468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.604748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.615673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.616988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-7c8c307a-e170-4e49-84f9-dc79a4c15c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:05.635940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:05.636888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:05.637810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:05.637810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:05.637810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:05.637810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:05.637810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 342/686] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:05.638683 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.638971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.639245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.654229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce12b9-8825-44aa-8bc8-8b13768d37c9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.657453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:05.658099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:05.699665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.700669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.701176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.701650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.703115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=79eb9c30fbae438784968a8f770a92f7) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:05.703680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.705981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.714225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 345/687] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/role_assignments?user.id=79eb9c30fbae438784968a8f770a92f7&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:05.715857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.735425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 343/688] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:05.756561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.844505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff407f-fdab-4cc1-9372-ddd4705d403e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.873591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4838-1b58-4894-ae70-f487f3402f21 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:05.899115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.901349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.901639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.901912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.902644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:05.902940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.904360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.929851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 346/689] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:05.933750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:05.936070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:05.936878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:05.939125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:05.939469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:05.959514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:05.961337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:05.996893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:05.997852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:05.998760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:05.998760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:05.998760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:05.998760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:06.005420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 344/690] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:06.007015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.078522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e136c3-17b9-4185-a93c-91fc9476adb4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.122284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.123186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.123580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.123921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.130816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:06.132064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248627d-e652-413e-a722-eb634ed72e23 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.132510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ca611f2f-f00b-4563-ae61-cbe6db3a004f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:06.147463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:06.148401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:06.149298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 347/691] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:06.150561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1039d-ad54-4c3d-8fb2-846225b6fc2a None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.151645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1039d-ad54-4c3d-8fb2-846225b6fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.152088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1039d-ad54-4c3d-8fb2-846225b6fc2a None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.153918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 348/692] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:06.154768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1039d-ad54-4c3d-8fb2-846225b6fc2a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.178249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.178920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.179489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.180796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.181529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:06.181839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:06.183417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618c11f-ef70-476d-b3bd-09544370d8ac None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:06.200139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 345/693] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:06.201542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.201830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.202105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.220178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:06.221267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:06.277777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1039d-ad54-4c3d-8fb2-846225b6fc2a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.299290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 346/694] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:06.299290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.340229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.341327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.341860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.342332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.343389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:06.343893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:06.345662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:06.359413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 349/695] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:06.360608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.415756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77960b-d827-43dc-a006-d159eb6d4512 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.450493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.451163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.451485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.451760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.452456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:06.453864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:06.462261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921da42-a645-4b37-a13d-40be57430c2b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.496330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.497039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.497317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.497648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.518353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:06.527196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:06.528343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:06.529191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 350/696] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:06.535147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.550465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 347/697] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:09:06 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:06.551506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.675047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97b9f-146d-4cab-a492-46f93b3a8d52 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.717941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.719026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.719680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.720160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.721229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=9ccd3c2454f94e998769076fbe20eb15) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:06.721802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:06.723553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:06.732870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 351/698] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:06 2022] GET /identity/v3/role_assignments?user.id=9ccd3c2454f94e998769076fbe20eb15&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:06.779246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80f04-7e67-4c3d-add2-4b53c5556b29 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:06.825400 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:06.826086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:06.826371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:06.826650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:06.827443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:06.827755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:06.829145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:06.839559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 348/699] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:06.845429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:06.958113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c70b-b9be-4d12-b5db-34a68e102484 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:07.001339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:07.002491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.002995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.003497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.014970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:07.016923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:07.035829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:07.036757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:07.037732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:07.037732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:07.037732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:07.037732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:07.037732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 352/700] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:07.044812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:07.159436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ac1c5-236d-403a-aa54-6e1e7e3f8c8a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:07.194585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:07.195247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.195553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.195826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.196540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:07.196924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:07.198375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:07.211222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 349/701] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:07.217581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:07.358546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63ce8-9326-4f66-a4be-5740c9cd3e6f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:07.406099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:07.406894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.407174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.407474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.420359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:07.421968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:07.442540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:07.451879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:07.452856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 353/702] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:07.453449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:07.592545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f805ea3-4918-4be8-bbc9-b9f7d976c62f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:07.640905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:07.641505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.642041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.642312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.643207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:07.643545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:07.645121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfbe36-90cd-41cb-91d0-0c183b5e6504 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:07.671787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 350/703] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:07.677432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:07.807205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e304475-85fb-4976-99a0-5e7a776b04b7 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:07.855423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dead7-f655-4640-9908-883c7383135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:07.856077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dead7-f655-4640-9908-883c7383135d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.856357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dead7-f655-4640-9908-883c7383135d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.856629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dead7-f655-4640-9908-883c7383135d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.880395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3daf19-4d09-49da-9dfd-5ba0eb05a9b9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.880719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3daf19-4d09-49da-9dfd-5ba0eb05a9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.880996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3daf19-4d09-49da-9dfd-5ba0eb05a9b9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.882581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 351/704] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:07.887949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045729dd-9634-4819-9c58-673dee07350e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:07.888244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045729dd-9634-4819-9c58-673dee07350e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:07.888527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045729dd-9634-4819-9c58-673dee07350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:07.905271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-045729dd-9634-4819-9c58-673dee07350e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:07.906399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-045729dd-9634-4819-9c58-673dee07350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:07.962731 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dead7-f655-4640-9908-883c7383135d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:07.964951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dead7-f655-4640-9908-883c7383135d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.009253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 352/705] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:09:08.043916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045729dd-9634-4819-9c58-673dee07350e None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.069443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 354/706] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:08.075000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dead7-f655-4640-9908-883c7383135d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.211035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045729dd-9634-4819-9c58-673dee07350e None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.257543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.258794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.259076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.259390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.260714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.262133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.287308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dead7-f655-4640-9908-883c7383135d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:08.290686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:08.291743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:08.292582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:08.295649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 353/707] 10.222.0.42 () {56 vars in 1129 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:08.301361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.339514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.341441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.342341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.345116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.361003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.364527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-bc9503d2-b089-4a2e-a17b-def555bdc476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:08.391956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:08.392934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:08.394484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:08.394484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:08.394484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:08.394484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:08.394484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 355/708] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:08.394914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353675-1341-4218-84f3-1582b746726b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.395070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353675-1341-4218-84f3-1582b746726b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.395361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22353675-1341-4218-84f3-1582b746726b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.399328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 356/709] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:08.400288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22353675-1341-4218-84f3-1582b746726b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.456037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12292c4-3cd6-4160-b74f-dd255f50b9f0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.493123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.494162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.495218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.495682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.496547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:08.497014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.498903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213c2c1-8c8f-4a4e-bb89-f016a02508da None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.504150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 354/710] 10.222.0.42 () {56 vars in 1124 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:08.505687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.506200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.506672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.521361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22353675-1341-4218-84f3-1582b746726b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.527587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:08.528833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:08.564232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.564897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.565175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.565515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.566245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:08.566548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.568167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.584565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 357/711] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:08.585931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.607230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 355/712] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:08.608557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.717210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949321f-5bbf-48bc-bdfc-7e10e19a6e4d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.754056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.754664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.755006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.755216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.755971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:08.756276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.757661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.765186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 358/713] 10.222.0.42 () {56 vars in 1124 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:08.766076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.866057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b6c1c-a10f-40e5-9db0-0ea35b6c9133 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.887998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e94d8-0027-4a27-bb21-6fdceff4a29c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:08.908101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.909457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.909975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.910470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.921113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.923130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:08.938221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:08.939228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:08.940141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:08.947285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:08.947285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:08.947285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:08.947285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] PATH_INFO: `/v3/services/network` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:08.947929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:08.947929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:08.948397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 356/714] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:08.950234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:08.979342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:08.980433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:08.981258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:08.986063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 359/715] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:08.992351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:09.108559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3363ff-d4d2-46c5-95ec-4798bfc9ee3b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:09.138285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da8b7-83f6-48d8-8e7b-b1252373b355 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:09.176942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:09.178030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:09.178299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.178703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.178973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.179087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.179293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.179751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.180099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:09.180472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:09.181071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] RBAC: Adding query filter params (name=network) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:09.181563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:09.182011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:09.183607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:09.188810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 360/716] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:09.198251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:09.220075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 357/717] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:09.237348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:09.353299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d4cd2-a472-4281-916b-362b8eb3c75f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:09.390511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:09.391974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.392457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.393053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.394072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=7bc226da24944f578dd20785b5bcece6) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:09.394577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:09.396615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f9c0-4303-4231-8a06-ad7dbd80d623 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:09.411745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 358/718] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:09 2022] GET /identity/v3/role_assignments?user.id=7bc226da24944f578dd20785b5bcece6&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:09.452422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a195-d653-4962-89e6-4d4bd4fc5612 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:09.532407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772a699-6cfd-48bc-85df-c66adbe2f273 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.532902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:09.533311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772a699-6cfd-48bc-85df-c66adbe2f273 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.533784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772a699-6cfd-48bc-85df-c66adbe2f273 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.534106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.534610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.535506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.535822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] RBAC: Adding query filter params (type=network) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:09.536131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:09.537293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 359/719] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:09.539700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:09.545999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.546610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.547089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.554347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 361/720] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:09.566932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:09.568552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:09.646005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 360/721] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 16:09:09.670436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:09.806271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2a26e-834c-4b55-aef7-f0bfa01e4b11 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:09.848042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:09.848862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:09.849138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:09.849411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:09.861638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:09.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:09.871473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:09.872778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 362/722] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:09.878576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:09.988137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedc94b-d42e-42d1-a337-87fe3d813bf2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:10.028258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:10.028944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.029231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.029512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.030265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:10.030575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:10.031985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab041f1c-ec61-4246-8219-b82e4d620f1c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:10.040742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 361/723] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:10.046687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:10.175611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9577-5f17-467e-b509-5e64a1ee148a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:10.220927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:10.221765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.222051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.222352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.238124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:10.239667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:10.249766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cea15f-2fde-40fa-a092-35b1b3a933f1 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.250366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cea15f-2fde-40fa-a092-35b1b3a933f1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.250366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cea15f-2fde-40fa-a092-35b1b3a933f1 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.251972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 362/724] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:10.257108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.257403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.257693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:10.260089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:10.260977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:10.261918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:10.261918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:10.261918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:10.261918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:10.264283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 363/725] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:10.269491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:10.292400 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:10.294556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:10.415673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 363/726] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:10.429022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecbd2-a141-4d11-ae49-a9402a2fb1bf None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:10.460112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:10.488483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:10.489960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.490471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.490940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.493063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:10.493573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:10.496338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:10.517738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 364/727] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:10.523601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:10.658956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878357c-5c76-4536-8ca2-a93b6a290e0b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:10.709458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9956b-0fa3-4706-a3f2-acba9d443752 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:10.728909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:10.729719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.730007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.730286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.746895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:10.748710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:10.748995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:10.749270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:10.756584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:10.765023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:10.766012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:10.767162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 364/728] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:10.771604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:10.773073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:10.774379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:10.801719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:10.804005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:10.806188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 365/729] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:09:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:10.813092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:10.960645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02fecd-6c32-46dc-ac07-dbacad27f0ad None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:10.969072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a548-21ea-440a-af64-728d684beb1e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.004747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.005342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.005653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.005930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.006766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:11.007076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.008611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.008828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.009506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.009822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.010095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.010839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:11.011142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.012526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.027882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 366/730] 10.222.0.42 () {56 vars in 1149 bytes} [Tue May 3 16:09:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:11.030673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 365/731] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:11.035977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.036183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.161200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568c5fb-5797-4f36-a24b-c7af14e8f4ce None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.199899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.200555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.200840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.201118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.261276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2601b4-e62f-4671-979f-208ec5c641bf None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.279226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.280717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.331974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.332790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.333073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.333350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.360369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.361832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:11.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:11.394142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:11.395021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:11.395021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:11.395021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:11.395021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:11.395275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 367/732] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:11.395355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 366/733] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:11.400050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.404263 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.503421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8ab4-b723-40f6-9b63-a0c8cc854cdf None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.552164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.552829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.553114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.553389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.554105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:11.554410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.555806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663aa1f-9d5c-4ef7-a0b4-4c4d5b00f897 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.561210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa30aa-af4e-49f9-9774-69521bafe8d5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.568277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 368/734] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:11.569589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f706f4-c122-4cdc-92f4-05c7ba04a80b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.569879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f706f4-c122-4cdc-92f4-05c7ba04a80b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.570163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f706f4-c122-4cdc-92f4-05c7ba04a80b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.577930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 369/735] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:11.579459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f706f4-c122-4cdc-92f4-05c7ba04a80b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.604760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.606006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.606570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.606858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.621816 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.623286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-f64db995-3794-41d2-89ad-f59be03f80dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:11.647609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:11.648550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:11.649445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:11.649445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:11.649445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:11.649445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:11.649445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 367/736] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:11.654111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267c20-445c-4009-8345-176613d66356 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.654111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267c20-445c-4009-8345-176613d66356 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.654111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267c20-445c-4009-8345-176613d66356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.673287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c7267c20-445c-4009-8345-176613d66356 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:11.674782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c7267c20-445c-4009-8345-176613d66356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:11.690830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f706f4-c122-4cdc-92f4-05c7ba04a80b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.727831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.729293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.729895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.730231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.739927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.742011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.750959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 368/737] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:11.752006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267c20-445c-4009-8345-176613d66356 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:11.768492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:11.770704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:11.772934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 370/738] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:11.783279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:11.872324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267c20-445c-4009-8345-176613d66356 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.889531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162dc6-9c80-4e62-ae7a-65b56fcd7044 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:11.919311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.920362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.920645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.921187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.921920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:11.922223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.924365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.928031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:11.928781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:11.929131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:11.929478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:11.930334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:11.932426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:11.938555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 369/739] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:11.939621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.042227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac1c6-b0a5-49ca-bc03-695f03421841 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.064106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 371/740] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:11 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:12.064766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.106989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.108084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.108665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.109145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.110236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:12.110775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:12.112497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd69448-088c-4e1e-8744-974b8d04221f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:12.135476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 370/741] 10.222.0.42 () {56 vars in 1135 bytes} [Tue May 3 16:09:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:12.137422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7ef0-6d41-4916-9b6a-74cbda5d3b43 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.137982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7ef0-6d41-4916-9b6a-74cbda5d3b43 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.138472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a7ef0-6d41-4916-9b6a-74cbda5d3b43 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.140560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 371/742] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:12.141898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a7ef0-6d41-4916-9b6a-74cbda5d3b43 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.260239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a7ef0-6d41-4916-9b6a-74cbda5d3b43 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.296762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35b5d7-27c7-4901-bd4f-898f1e2b9499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.297365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35b5d7-27c7-4901-bd4f-898f1e2b9499 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.297619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35b5d7-27c7-4901-bd4f-898f1e2b9499 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.297907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35b5d7-27c7-4901-bd4f-898f1e2b9499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.337484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7913-2e76-4307-9314-53ed7cd149ad None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.369749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35b5d7-27c7-4901-bd4f-898f1e2b9499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:12.370759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.371188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35b5d7-27c7-4901-bd4f-898f1e2b9499 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:12.371594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.371874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.372147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.378724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:12.380211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-41daa9ef-25b9-4931-8689-f5877eba503d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:12.395007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:12.396042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:12.396941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 372/743] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:12.397886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.397886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.398059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.414676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:12.415896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:12.478083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 372/744] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 16:09:12.479592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86eb89-8142-499f-a879-9b83a1949339 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.479883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86eb89-8142-499f-a879-9b83a1949339 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.480159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86eb89-8142-499f-a879-9b83a1949339 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.481555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 373/745] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:12.482164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86eb89-8142-499f-a879-9b83a1949339 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.491326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 373/746] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:12.491326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.584132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86eb89-8142-499f-a879-9b83a1949339 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.601892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de146e-0d63-4408-93b0-61917fd2e02f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.616366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.617030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.617315 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.617592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.619595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:12.619595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:12.620799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c6ab4-8130-4e3b-9297-8044943665d2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:12.637949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 374/747] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:12.637949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.637949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.637949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.641975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.642917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.643326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.643700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.653735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:12.655098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:12.656356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:12.658321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:12.679056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:12.680147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:12.682237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:12.682237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:12.682237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:12.682237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:12.682237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 374/748] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:12.682237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.724646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 375/749] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 16:09:12.725480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.795016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f71687-a69b-43cd-ae9c-8d94a1510ca5 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.820949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377136-7cef-455d-b59b-80d59277c916 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.831226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.832531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.832813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.833128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.845930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:12.856528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:12.857479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:12.858325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 375/750] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:12.859775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.865883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:12.866543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:12.866831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:12.867115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:12.867982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=29989d1545154c4093f9c43c4c7abe37) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:12.868299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:12.870472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:12.876202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 376/751] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/role_assignments?user.id=29989d1545154c4093f9c43c4c7abe37&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:12.876956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:12.997674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2950c8-e5c6-402e-923e-5590c7fd3e69 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:12.997895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a78e85-d4b6-40f7-8e72-7929e19f5864 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.034685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.035394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.035688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.035967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.036087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.036633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.036740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.036917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.037193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.037924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:13.038112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.038275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.039648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.053686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 376/752] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:13.054560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.135555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 377/753] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:12 2022] POST /identity/v3/services => generated 240 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:13.136468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.162956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5337c-d1cc-4644-971a-7b07988dd8e9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.252993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.253690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.253971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.254488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.255279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:13.255590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.256978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.277811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 377/754] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:13.283949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.319460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784691-9c90-4334-9631-c8ff7d7f0408 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.355796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.356890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.357340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.357755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.365991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.367649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:13.383654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:13.385329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:13.386385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:13.388473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 378/755] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:13.393827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.425411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a528468-54aa-4b6b-a22a-bae178c87ec4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.472448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.474016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.474446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.474944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.488848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.491066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.519466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd563f-b46a-4ce1-bab8-de7fa653cdf2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:13.519848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:13.520881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:13.521988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:13.521988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:13.521988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:13.521988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:13.524823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 378/756] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:13.533945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.566660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.568134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.568879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.569357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.570339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:13.570896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.574012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.589755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 379/757] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:13.595216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.678301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9bf4-3e7b-4ef5-b1d4-992318be2209 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.709738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f1c1d-267a-4d6f-872e-0563192c2ba7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.746966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.748331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.748960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.749438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.750482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=9ccd3c2454f94e998769076fbe20eb15) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:13.750999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.752938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.760193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 380/758] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/role_assignments?user.id=9ccd3c2454f94e998769076fbe20eb15&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:13.777570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.778259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.778541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.778813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.779605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:13.779914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.781287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.805293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 379/759] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:13.811522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:13.925589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34e9af-5654-4d9d-a5d9-be948572fa3e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:13.962435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:13.964211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:13.964696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:13.965164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:13.974052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:13.975912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:13.990929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:13.991958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:13.992894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:13.995916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 381/760] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:14.001399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:14.138052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918b670-88c0-4e06-8a84-32b7fd50c9cd None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:14.171819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:14.172498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.172807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.173083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.173921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:14.174229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:14.175696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:14.201578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 380/761] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:14.207122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:14.338532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db49cb-a394-4d8a-9f5f-bf668dbbd4f9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:14.372875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:14.374032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.374512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.374980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.386529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:14.388248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-bce170b7-5330-4071-a870-f56c2a2bb0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:14.405782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:14.406702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:14.407626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:14.407626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:14.407626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:14.407626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:14.409882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 382/762] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:14.415075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:14.454909 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c8ae-35a1-43cf-9d0c-601d932b5ed0 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.455664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c8ae-35a1-43cf-9d0c-601d932b5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.456143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c8ae-35a1-43cf-9d0c-601d932b5ed0 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.458017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 383/763] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:14.463231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.463871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.464370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.482776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:14.484418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:14.567307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf7508-81df-4222-8fed-202c958b68d3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:14.621511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 384/764] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:14.630635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:14.631317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.631599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.631871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.632583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:14.632882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:14.639791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:14.644617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:14.667400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 381/765] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:14.676250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:14.782541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61101-c0ac-415c-9d2b-2c9c50be89a2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:14.835689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c395-2326-4100-ae2c-dda7ba1b7ab7 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:14.864908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:14.865740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.866003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.866282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.866933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:14.868560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:14.882244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:14.883403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:14.883892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:14.884369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:14.888934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:14.889858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:14.890721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:14.899791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:14.902652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:14.904304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1129 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:14.910819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:14.935872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:14.936864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:14.937753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:14.945526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 382/767] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:14.948712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:15.090884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad768a-e448-486c-bf6a-201e0610af00 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.135635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.136224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.136505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.136777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.137449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa60c-dcf3-4011-ac3e-89cc6be2aa3c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.137577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:15.137765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:15.139149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:15.148638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 386/768] 10.222.0.42 () {56 vars in 1124 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:15.149972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:15.236024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.236715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.237000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.237280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.238149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:15.238400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:15.239934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:15.254445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139dd26-94b9-4c5a-bbc1-d6dc0a636948 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.268511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 383/769] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:15.274471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:15.291993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.292664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.292937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.293208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.293912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:15.294215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:15.295606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:15.306246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 387/770] 10.222.0.42 () {56 vars in 1124 bytes} [Tue May 3 16:09:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:15.307554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:15.409729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9868466-2e54-41f6-95e4-ca5a8dbb966f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.445285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.448092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.448092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.448092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.448092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] RBAC: Adding query filter params (interface=public, service_id=37d71f3e01fc4eb5925dbcb877b3267d, region_id=RegionOne) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:15.448092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:15.449353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf7275-ac68-4888-9d94-dec561fc8bb5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:15.458092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b1f1-bfef-4814-9755-c37e9db056ad None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.460118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 388/771] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:15 2022] GET /identity/v3/endpoints?service_id=37d71f3e01fc4eb5925dbcb877b3267d&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:15.461452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42501d-26d1-49f1-ae42-d56e708a681c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.461743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42501d-26d1-49f1-ae42-d56e708a681c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.462022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42501d-26d1-49f1-ae42-d56e708a681c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.465394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 389/772] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:15.466179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42501d-26d1-49f1-ae42-d56e708a681c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:15.503218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0a192-eb1f-4a39-aa20-6f2da548cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.504232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a192-eb1f-4a39-aa20-6f2da548cc26 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.507275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a192-eb1f-4a39-aa20-6f2da548cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.507275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a192-eb1f-4a39-aa20-6f2da548cc26 None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/7bc226da24944f578dd20785b5bcece6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.507275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0a192-eb1f-4a39-aa20-6f2da548cc26 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=7bc226da24944f578dd20785b5bcece6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:15.509161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0a192-eb1f-4a39-aa20-6f2da548cc26 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:15.580386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42501d-26d1-49f1-ae42-d56e708a681c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.590579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 384/773] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:15 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/7bc226da24944f578dd20785b5bcece6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:15.591964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.592253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.592529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.611355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:15.612621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:15.620542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.621863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.622353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.622829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.623779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:15.625496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:15.639596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 390/774] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:15 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:15.701993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 385/775] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:15.736134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:15.893752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2a82c-6ce5-48c1-8f4a-68275784973b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:15.930791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:15.932693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:15.933177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:15.933673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:15.954160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:15.961814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:15.962782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:15.963888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:15.967744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 391/776] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:15.973401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.110336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e1b90-8aec-42e9-8d84-cfea3aa6253b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:16.158791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:16.159534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.159788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.160063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.160814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:16.161115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:16.162476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01314e9-7dde-4a6a-b5ec-c9b1d2d161fa None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:16.172393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 386/777] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:16.177475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.290564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187efc5-1823-4d6d-a4a1-e8865bbadc29 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.290937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187efc5-1823-4d6d-a4a1-e8865bbadc29 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.291273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187efc5-1823-4d6d-a4a1-e8865bbadc29 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.293312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 387/778] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:16.298404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.298693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.298972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.317208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:16.318894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:16.330295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee1ab6-d0d6-42fb-91a6-e7ba73669bfb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:16.403958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:16.404767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.405050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.405329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.417751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 388/779] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:16.425516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:16.426971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:16.444957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:16.460187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:16.461168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:16.462110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:16.462110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:16.462110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:16.462110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:16.464433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 392/780] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:16.472250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.649829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0d07-d4f1-4cf7-9b84-069e07867b38 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:16.692735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7e88-8ed9-4a51-be15-2394795ee957 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:16.705963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:16.707234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.707718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.708168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] PATH_INFO: `/v3/services/network` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.709291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:16.711680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:16.735015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:16.736109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:16.736970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:16.747918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 389/781] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:16 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:16.754948 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.772073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:16.772754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.773039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.773316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.774039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:16.774344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:16.776452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:16.797385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 393/782] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:16.805254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.908129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5c4e-a6a7-4527-a21e-9db5e7524228 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:16.923693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfe41a-b66d-4b24-b144-0ecea5fdae4a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:16.950511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:16.951354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.951800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.952084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.953256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] RBAC: Adding query filter params (name=network) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:16.953705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:16.955276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9e3af-2bec-4610-b390-3e73af3f603f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:16.960746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:16.961013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 390/783] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:16.961560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.961845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.962122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.962347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88272b30-3d0b-4e5b-8c3a-b447d54a4b29 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:16.963423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88272b30-3d0b-4e5b-8c3a-b447d54a4b29 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:16.963771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88272b30-3d0b-4e5b-8c3a-b447d54a4b29 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:16.965650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 391/784] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:16.968301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88272b30-3d0b-4e5b-8c3a-b447d54a4b29 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:16.976102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:16.977574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b9973d40-d3f1-4d65-bbcc-95802c5d35b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:17.001675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:17.002681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:17.003768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 394/785] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:09:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:17.004871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baa8df-393f-4566-972f-860842663166 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.005053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baa8df-393f-4566-972f-860842663166 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.007376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baa8df-393f-4566-972f-860842663166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.026597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-42baa8df-393f-4566-972f-860842663166 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:17.028043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-42baa8df-393f-4566-972f-860842663166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:17.107016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88272b30-3d0b-4e5b-8c3a-b447d54a4b29 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.133144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 395/786] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:17.135107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baa8df-393f-4566-972f-860842663166 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.175854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.176447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.176726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.177000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.177952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:17.178266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.179912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.186861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 392/787] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:17.188075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.272744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baa8df-393f-4566-972f-860842663166 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.297932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecafc0d-20fe-4691-a487-1ae3c5d332a0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.316470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.317472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.317988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.318479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.319541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:17.320054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.321668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.331389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.332121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.332408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.332669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.343833 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:17.347172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 396/788] 10.222.0.42 () {56 vars in 1149 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:17.348289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:17.352314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:17.354024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:17.355053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:17.358479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 393/789] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:17.359363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.474651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6f45e-6ee5-47bc-992d-854dc8d3df2b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.475975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee92c89-d92c-47e0-95be-acb43d37bbb3 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.521695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.522365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.522651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.522929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.523748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] RBAC: Adding query filter params (interface=public, service_id=de3c4b4e19e14df48077860eb3566dc0, region_id=RegionOne) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:17.524074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.526445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.528616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.530314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.530799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.531326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.532109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 397/790] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/endpoints?service_id=de3c4b4e19e14df48077860eb3566dc0&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:17.532895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.544726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.546888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:17.568435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:17.569375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:17.570257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:17.570257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:17.570257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:17.570257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:17.573838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 394/791] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:17.575085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.656596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b1442-c3e6-47d2-afa1-2387c562479e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.695785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.696460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.696744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.697735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.698282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914726e-a8b6-4768-9b8e-5b2c63673b5e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.698563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:17.698876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.700313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.714966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 398/792] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:17.714966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.749705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.750859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.752141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.752651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.753599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.755179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.763160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 395/793] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:17.764904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.825423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c78be-1d1c-4491-b8c2-4719e94c323e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.870797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.872115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.872579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.873179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.874560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:17.875126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.877131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.879791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207d89-01c4-49e2-8c89-8942773351dc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:17.894411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 399/794] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:17.904371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:17.932744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:17.933578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:17.933888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:17.934166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:17.960647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:17.964021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:17.995929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:17.996900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:17.998222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:17.998222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:17.998222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:17.998222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:17.998222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 396/795] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:18.004001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.108817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d664d75-1a9b-4c6d-ba8e-970ec7366f9f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.116807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c94ed6-8578-44fa-8f66-261b3ff43b04 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.161551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1de390-63ef-4170-9428-24344337b08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.162287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1de390-63ef-4170-9428-24344337b08d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.162575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1de390-63ef-4170-9428-24344337b08d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.162852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1de390-63ef-4170-9428-24344337b08d None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.163615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1de390-63ef-4170-9428-24344337b08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:18.163928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1de390-63ef-4170-9428-24344337b08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.165376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1de390-63ef-4170-9428-24344337b08d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.177652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.178503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.178855 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.179141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.191567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 397/796] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:18.196364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.198616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.203247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1de390-63ef-4170-9428-24344337b08d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:18.228578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:18.229562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:18.230699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 400/797] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:18.238799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.377616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1de390-63ef-4170-9428-24344337b08d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.402881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1baa614-5ece-4fc9-bc2b-6b78d4090941 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.413805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.414605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.414888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.415165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.422709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.424336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.434916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.435591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.435875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.436146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.436922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:18.437227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.438623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454e73-7207-4312-8947-0631164d5f5f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-7094685e-9062-49e0-9dbe-1c5dc91a9ddd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:18.439421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:18.440338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:18.441333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 398/798] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:18.446401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0754d4-a91d-4ccf-9552-11bdd0aca6ff None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.446692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0754d4-a91d-4ccf-9552-11bdd0aca6ff None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.451354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0754d4-a91d-4ccf-9552-11bdd0aca6ff None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.451354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 399/799] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:18.451354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1559c-3e6a-410d-95c4-7960899ca04c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.451354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1559c-3e6a-410d-95c4-7960899ca04c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.451354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1559c-3e6a-410d-95c4-7960899ca04c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.455436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 400/800] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:18.455436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1559c-3e6a-410d-95c4-7960899ca04c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.459133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 401/801] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:18.464737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63728043-045b-43cc-acc6-bc9b8a55da84 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.464737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63728043-045b-43cc-acc6-bc9b8a55da84 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.464737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63728043-045b-43cc-acc6-bc9b8a55da84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.477204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-63728043-045b-43cc-acc6-bc9b8a55da84 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:18.478412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-63728043-045b-43cc-acc6-bc9b8a55da84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:18.550412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 402/802] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:18.551757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.552052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.552335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.568794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:18.569701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1559c-3e6a-410d-95c4-7960899ca04c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.569959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:18.604557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.605227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.605507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.605781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.606603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:18.606908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.608353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.625950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 401/803] 10.222.0.42 () {56 vars in 1135 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:18.626755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.642143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 403/804] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:18.642936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.734407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d752-8dbf-4f8d-a7e5-c2d765010459 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.744755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80836e3-1422-4bd4-a8c4-50bb80b61d00 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.769085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.769964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.770239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.770509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/29989d1545154c4093f9c43c4c7abe37/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.781246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.782055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.782347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.782628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.783299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.784675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.785226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=29989d1545154c4093f9c43c4c7abe37, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.786620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:18.797192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:18.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:18.804030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 404/805] 10.222.0.42 () {56 vars in 1129 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:18.804897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.887047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 402/806] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:18 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/29989d1545154c4093f9c43c4c7abe37/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:18.888271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:18.904011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511022-ebb9-49bf-bae9-4af057f4fecc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:18.950685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:18.951869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:18.952829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:18.953297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:18.970971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:18.973762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:18.997661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:18.998621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:18.999557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:18.999557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:18.999557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:18.999557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:19.005463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 405/807] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:19.005463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.013318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506976a2-034b-4ec9-8bfe-ed4dc3b9838e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.050446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.051673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.052169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.052649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.066298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:19.074924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:19.076266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:19.077108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:19.081862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 403/808] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:19.082938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.145631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2a23d-0000-4045-a1bc-1858299866c4 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.191037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.192050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.192482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.192926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.193478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594eca3-2ac8-439d-898a-20b6aabf4055 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.194279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:19.194729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.197818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.203611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 406/809] 10.222.0.42 () {56 vars in 1124 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:19.204662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.236264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.237176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.237820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.238268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.239746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:19.240200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.242168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.258279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 404/810] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:19.263354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.336142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b967225-5f3a-483e-88bd-5e5f7036c87a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.363235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b8c9a-671d-4da3-9cb6-fd4df700fecc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.379163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.380294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.380806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.381512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.382427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:19.382927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.385436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.396663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 407/811] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:19.397646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.403218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.403615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.403946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.404217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.404919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:19.405225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.406584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.416256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 405/812] 10.222.0.42 () {56 vars in 1124 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:19.417235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.530700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972322ba-a7cc-4840-afd5-3334fe2f88b9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.542657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb2cd4-c9b1-4cda-9c51-0623a9e881fc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.566533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.567579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.568277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.568277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.575111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.576745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.584320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.585292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.585720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.586139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:19.592543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:19.593629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:19.594731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:19.600462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 408/813] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:19.601013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.601426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.602864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:19.626511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:19.627523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:19.628407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:19.628407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:19.628407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:19.628407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:19.633895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 406/814] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:19.633895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.713584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c21e-00b0-4fa7-9c1b-e05a171c4bec None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.752917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b036d5-d22b-4343-953f-21a06a5a9386 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:19.756904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.757807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.758321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.758803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.760431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.762479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.788505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:19.789174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:19.789474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:19.789715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:19.790585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:19.790980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:19.792443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:19.808934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 407/815] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:19.808934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.896226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 409/816] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:19.897552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:19.933567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7b96-4e5c-424e-9266-fc973ec49426 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.016546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.017666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.018190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.020160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.021130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:20.021663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.023298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.053814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 408/817] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:20.064786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:20.106104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a82a7-5c32-47b6-b7ac-21aa50c27094 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.142635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f6b26-5f48-48b6-9eab-d4047d3af7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.144069 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6b26-5f48-48b6-9eab-d4047d3af7de None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.144604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6b26-5f48-48b6-9eab-d4047d3af7de None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.145085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6b26-5f48-48b6-9eab-d4047d3af7de None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/9ccd3c2454f94e998769076fbe20eb15/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.147446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f6b26-5f48-48b6-9eab-d4047d3af7de None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=9ccd3c2454f94e998769076fbe20eb15, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.149128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f6b26-5f48-48b6-9eab-d4047d3af7de None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.227122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479db23-e985-4638-bbf6-0ba61e2379d6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.260538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 410/818] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:19 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/9ccd3c2454f94e998769076fbe20eb15/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:20.262234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b8e5-40eb-4b5b-a904-1c33d9fc0e94 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.263531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b8e5-40eb-4b5b-a904-1c33d9fc0e94 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.264047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b8e5-40eb-4b5b-a904-1c33d9fc0e94 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.266645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 411/819] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:20.274063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.276095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.277326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.296179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.298286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.298286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.298286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.314793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.316121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:20.317337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:20.318970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:20.341507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:20.342524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:20.343535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 409/820] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:20.349064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:20.467593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8233d-f7bf-4c6f-8d5e-bdb991f0b26d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.490038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 412/821] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:20.514520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.515207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.515521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.515801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.516926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:20.517238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.518678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.534057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:20.545640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:20.552177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:20.646567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f8210-92ff-4da1-a010-beb76a692970 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.658503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15562a-992d-47a6-a0f5-a6d88ae1f55c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.686763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.687610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.687897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.688175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.688831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.690301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.693696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.694373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.694655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.694931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:20.715699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:20.718034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:20.720083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:20 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:20.726013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:20.827645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.829107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.921727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e05c71-6b62-4b8d-ac08-5da6970d5de9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:20.952617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 411/824] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 16:09:20.958473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:20.989634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:20.990311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:20.990595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:20.990897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:20.991640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] RBAC: Adding query filter params (name=network) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:20.991948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:20.999278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:20.999278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 414/825] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:21.004582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.130236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e4b0f-b642-4ec2-be36-2b401e800c42 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.166161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.167312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.167603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.167880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.178563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:21.180303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:21.199820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:21.200997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:21.202131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:21.202131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:21.202131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:21.202131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:21.203798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 412/826] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:21.210713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.213599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0669eb0-8c1b-41ef-8566-5c4070c73d24 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.278131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.278811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.279102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.281736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.282475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:21.282789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:21.288746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:21.300046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 415/827] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:21.305478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.386879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601c9a3-34fe-495a-9a20-0e0bb5057acb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.425386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.426056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.426339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.426636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.427377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:21.427686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:21.429102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4dd8-4141-4a7b-ad02-49b01ae96e35 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:21.445889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 413/828] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:21.447376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68140a2-39c2-4758-a206-a122db2c6b2f None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.451742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68140a2-39c2-4758-a206-a122db2c6b2f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.452043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68140a2-39c2-4758-a206-a122db2c6b2f None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.461641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 414/829] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:21.461641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68140a2-39c2-4758-a206-a122db2c6b2f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.476192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c433-28bb-4c7f-ad22-e58913b9f2f5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.512929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d88f3-3f8d-4a06-8383-39c2d4b48792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.513695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d88f3-3f8d-4a06-8383-39c2d4b48792 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.513983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d88f3-3f8d-4a06-8383-39c2d4b48792 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.514263 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d88f3-3f8d-4a06-8383-39c2d4b48792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.515038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d88f3-3f8d-4a06-8383-39c2d4b48792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:21.516707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d88f3-3f8d-4a06-8383-39c2d4b48792 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:21.567826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68140a2-39c2-4758-a206-a122db2c6b2f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.601960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.603623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.604106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.604557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.619825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 416/830] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:09:21.621040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:21.621478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.621777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.622058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.622576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:21.646640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:21.647647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:21.649012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 415/831] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:21.654913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.658201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:21.660347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:21.795766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 417/832] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:21.819192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.865029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292ea2b-2d27-4451-8a80-e68d5945f274 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.905293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.906291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.906857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.907376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.908399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:21.908925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:21.910550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:21.924570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 416/833] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:21.929994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:21.944696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136b3ad-56de-4580-9979-2b92ffd24f43 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:21.982844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:21.983724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:21.984013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:21.984295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:21.995494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:22.003415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:22.004394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:22.005237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 418/834] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:09:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:22.011149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.053867 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e03a-4e31-4138-a329-d1045be9914e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.095611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.096632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.097187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.097668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.098778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=7bc226da24944f578dd20785b5bcece6) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:22.099311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.100965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.109273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 417/835] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:21 2022] GET /identity/v3/role_assignments?user.id=7bc226da24944f578dd20785b5bcece6&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:22.144179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d4e78-d0a8-4980-9612-14c4cae50654 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.181920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.182617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.182905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.183188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.183994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:22.184307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.185735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.195671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 419/836] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:22.201477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.319439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4c0b-9a7e-4ab8-9564-452e6417a2f4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.357392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.358293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.358584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.358860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.370660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.372144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-6c6ba98c-d491-4f72-a5cc-00a559da2dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:22.389550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:22.391230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:22.392199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:22.392199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:22.392199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:22.392199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:22.392199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 418/837] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:22.399033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.495338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ae4d-82d6-4351-aa6e-7da47091a3a0 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.495580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ae4d-82d6-4351-aa6e-7da47091a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.496204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ae4d-82d6-4351-aa6e-7da47091a3a0 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.497490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 419/838] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:22.502773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.503061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.503368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.505621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcd12-34cb-4c57-b29b-47724d812e6e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.520521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:22.521702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:22.550745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.552215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.552818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.553370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.554447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:22.555033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.556699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.576992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 420/839] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:22.578481 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.594492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 420/840] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:22.617208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.698204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524e35d-442c-4737-9bbc-ef7e79334c2c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.722647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524cb66-1c1e-4fca-9d79-909e4c8a4845 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.741219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.742389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.742887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.743486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.754779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.757035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.760138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.761093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.761445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.761812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.762546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.764051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:22.777138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:22.778217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:22.779151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:22.779733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:22.781085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:22.781907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:22.783886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 421/841] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:22.789175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.789385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 421/842] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:22.791884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.884874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09671-4dc8-4968-b160-57685d7118ee None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.918084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed66c25-487d-4ba1-bb0b-a59edaed6576 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:22.934370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.935632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.936306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.937087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.938093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:22.938610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.940737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b65c5a-7895-4408-99f9-a3ae0c400969 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.951797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 422/843] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:22.952980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c83d-aaa8-4524-9b75-a9f41cf69e5d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.953272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c83d-aaa8-4524-9b75-a9f41cf69e5d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.953558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c83d-aaa8-4524-9b75-a9f41cf69e5d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.954820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 423/844] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:22.955700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887c83d-aaa8-4524-9b75-a9f41cf69e5d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:22.959128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:22.960671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.960961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.961241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:22.962107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:22.962519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:22.964080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5c7b-c401-448d-bfe2-9030360bf268 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:22.982002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 422/845] 10.222.0.42 () {56 vars in 1149 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:22.983117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:22.983436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:22.983719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.001103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:23.002307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:23.074334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887c83d-aaa8-4524-9b75-a9f41cf69e5d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.083702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 423/846] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:23.084621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.114680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.115417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.115703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.116157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.116673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:23.116969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.118327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.123219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 424/847] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:23.123943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.226961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f97215-1810-462b-93e3-e347dba475fd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.229332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384652b-ca1a-437a-80cb-9e52f6ef8b59 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.270188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.270422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.270857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.271080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.271187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.271370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.271466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.271652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.284502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:23.292900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:23.293927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:23.294794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 425/848] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:23.300291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.377186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.379872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.429227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad8284-690c-46b5-8beb-2f65c2d67016 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.464791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.465954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.466469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.467012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.467992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:23.468522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.470087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.480748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 426/849] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:23.485808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.514842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 424/850] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:09:23.516294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.613788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c6a6-909b-439c-ab74-e6cbb259296f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.633057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbaa9a-2ff7-42c2-8e4a-1838d00d1aa8 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.656854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.658034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.658519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.659121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.673611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.675555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.675997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.676977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.677305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.677639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.689066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.691021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:23.701429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:23.702317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:23.703325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:23.703325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:23.703325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:23.703325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:23.709815 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 427/851] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:23.710061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:23.711284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:23.712741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:23.712741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:23.712741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:23.712741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:23.714190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.715674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 425/852] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:23.718033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.823001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f3fb-79af-4189-a5ae-9fe0b8756fe9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.846360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873df9-f442-45a1-9e6a-7d17863487ec None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:23.857198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.857877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.858164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.858445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.859166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:23.859505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.860934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.873380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 426/853] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:23.878497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.891786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:23.892454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:23.892745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:23.893023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:23.893744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:23.894052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:23.895504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:23.908170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 428/854] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:23.913459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:23.998055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909e9d-d897-416c-989e-70d5091db4fa None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.024162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82154-fc87-404a-8ffd-9a46260bfe45 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.035964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.036910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.037047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.037288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.044879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.046490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:24.061375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:24.062495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:24.063638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:24.064190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.065131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.065532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.065940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.067248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 427/855] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:24.068095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.077070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.078870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:24.095191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:24.096368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 16:09:24.097376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:24.099536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 429/856] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:24.106003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.175711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1984f1-ea06-49f7-9403-e2af24c0b708 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.212677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.213355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.213636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.214059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.214740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:24.215098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.216560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.233879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 428/857] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:24.236339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.238326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e626d-5b4c-4dda-9fa6-93d14f5c9123 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.275601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.276353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.276743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.277085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.277984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:24.278358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.280659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.305603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 430/858] 10.222.0.42 () {56 vars in 1135 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:24.307173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.353637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f49fa-c18a-4f1d-a104-a8b80e77aa3c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.390077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.391309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.391769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.392245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.393261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=29989d1545154c4093f9c43c4c7abe37) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:24.393811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.395452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8cb8-627a-4f0d-a71f-4a071b5935b7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.407467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 429/859] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/role_assignments?user.id=29989d1545154c4093f9c43c4c7abe37&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:24.418032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cff34-7e7d-4468-8c03-ba07791432e9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.456924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.457599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.457835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.458108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.534832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.536373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.543991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce645a-0563-45f5-ad60-1e74cc1a379d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.544291 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce645a-0563-45f5-ad60-1e74cc1a379d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.544565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce645a-0563-45f5-ad60-1e74cc1a379d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.546353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 430/860] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:24.551891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.552177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.552464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.570512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:24.571976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:24.656054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 431/861] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:09:24.656647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.673158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 431/862] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:24.695220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.777258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18822ffd-e503-4cc0-9b93-be2cefc72c44 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.815462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.816347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.816633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.816902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.828268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.829019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842dfea-20ce-4527-8370-d608ebb9fffb None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:24.830635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:24.854346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:24.855355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:24.856674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:24.856674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:24.856674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:24.856674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:24.856674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 432/863] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:24.861294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.870073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:24.871202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:24.871715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:24.872213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:24.873064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:24.874640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:24.887943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:24.888928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:24.889760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:24.892641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 432/864] 10.222.0.42 () {56 vars in 1132 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:24.899171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:24.982348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d87b44-345e-4abf-a51e-3c5a834e015f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.013482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8e62a-7f49-4783-a6bf-8d09b954ad48 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.026487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.027244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.027618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.028066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.029114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:25.029789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.031434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.047299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 433/865] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:25.052026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:25.054321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.054989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.055286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.055575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.056421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:25.056727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.058089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.063293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 433/866] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:25.069641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:25.166809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fd1f0-11b6-4b6e-b0dc-f476cb644eb1 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.197982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09b985-69e7-4a56-9341-1ae914d352d9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.200090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.201143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.201598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.202043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.209051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.210686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:25.225720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:25.226673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:25.227681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:25.234792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 434/867] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:25.235596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:25.240892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.241561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.241843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.242117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.242823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:25.243126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.244593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.255314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 434/868] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:25.359817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e70dd3-53c7-454b-ae65-6a009353e685 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.398336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.399058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.400073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.400503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.401527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:25.401844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.403472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641b85-3bc3-4a09-86ff-7622bbfd1324 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.418837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 435/869] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:25.424986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:25.471357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0418b-d5ef-4382-b5bf-1d973b1d8dc7 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.471977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0418b-d5ef-4382-b5bf-1d973b1d8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.471977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0418b-d5ef-4382-b5bf-1d973b1d8dc7 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.473593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 436/870] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:25.479932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf561c-9bb5-4f19-a283-8ef39c865be2 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.480222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf561c-9bb5-4f19-a283-8ef39c865be2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.480501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf561c-9bb5-4f19-a283-8ef39c865be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.509623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0bbf561c-9bb5-4f19-a283-8ef39c865be2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:25.509623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0bbf561c-9bb5-4f19-a283-8ef39c865be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:25.536839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c45ba-87be-47e2-bbd7-7030d37bdb89 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.573110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.574142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.574676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.575158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.576208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=9ccd3c2454f94e998769076fbe20eb15) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:25.576728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.578389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.585261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 435/871] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:25 2022] GET /identity/v3/role_assignments?user.id=9ccd3c2454f94e998769076fbe20eb15&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:25.597028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 437/872] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:25.620587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:25.739061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3413d-e80b-4afd-8b76-2d72b906c106 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:25.777262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7e0bb-1904-4efb-80a5-48fb861ec28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:25.778320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7e0bb-1904-4efb-80a5-48fb861ec28b None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:25.778811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7e0bb-1904-4efb-80a5-48fb861ec28b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:25.779315 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7e0bb-1904-4efb-80a5-48fb861ec28b None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:25.780254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7e0bb-1904-4efb-80a5-48fb861ec28b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:25.781841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7e0bb-1904-4efb-80a5-48fb861ec28b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:25.858736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 436/873] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:25 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:26.872945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85dd4f-c3d2-4829-9ac9-dcdb12e71649 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:26.873585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85dd4f-c3d2-4829-9ac9-dcdb12e71649 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:26.873585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85dd4f-c3d2-4829-9ac9-dcdb12e71649 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:26.875101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 438/874] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:26.880395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:26.880822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:26.881004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:26.898353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:26.900147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:26.974978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 437/875] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:26.998893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85dd4f-c3d2-4829-9ac9-dcdb12e71649 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.102658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85dd4f-c3d2-4829-9ac9-dcdb12e71649 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:27.138581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:27.139345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.139633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.139910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.151175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:27.159528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:27.160584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:27.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 439/876] 10.222.0.42 () {56 vars in 1120 bytes} [Tue May 3 16:09:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:27.167579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.268615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20756d-488e-48b8-ac9a-69589d71b9b3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:27.303872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:27.304548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.304832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.305110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.305910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:27.306220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:27.307713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:27.316334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 438/877] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:09:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:27.322574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.426991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015048-ab7c-4886-b5ce-7dec42768944 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:27.466365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:27.467194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.467509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.467785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.482109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:27.483592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-761e224d-6d23-4757-a6f3-e3c8e8ede67c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:27.501874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:27.504028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:27.506244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:27.506244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:27.506244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:27.506244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:27.511275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 440/878] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:27.511512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.614366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdb14-0cba-4150-a92d-77a9eea3d6ba None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:27.638034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44d9d-661f-4634-bffe-c6dada5c7fc3 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.638662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44d9d-661f-4634-bffe-c6dada5c7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.639140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44d9d-661f-4634-bffe-c6dada5c7fc3 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.641652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 441/879] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:27.646079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.646361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.646636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.651796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:27.652651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.652984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.654107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.654841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:27.655159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:27.656580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:27.664047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:27.665766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:27.671556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 439/880] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:27.677278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.743403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 442/881] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:27.760809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.798624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2e4e3-2e6d-4e04-b5f8-e95cf1a89bc5 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:27.833290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:27.834496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.835009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.835518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.843645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:27.845403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:27.861757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:27.862799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:27.863797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:27.866421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 440/882] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:09:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:27.871960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:27.886252 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77652b-290c-406a-94bf-f4e52d6bbfb5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:27.929198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3de14-c839-4cea-b3b4-71a237ca3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:27.929790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3de14-c839-4cea-b3b4-71a237ca3029 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:27.930077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3de14-c839-4cea-b3b4-71a237ca3029 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:27.930356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3de14-c839-4cea-b3b4-71a237ca3029 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:27.931194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3de14-c839-4cea-b3b4-71a237ca3029 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:27.932624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3de14-c839-4cea-b3b4-71a237ca3029 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:27.972125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7b033-a645-4e64-8d3f-2957a89662cc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.004553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fa832-722a-46a7-910d-544b86862dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.005276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fa832-722a-46a7-910d-544b86862dce None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.005559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fa832-722a-46a7-910d-544b86862dce None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.005831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fa832-722a-46a7-910d-544b86862dce None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.006653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fa832-722a-46a7-910d-544b86862dce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:28.006959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fa832-722a-46a7-910d-544b86862dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.008401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fa832-722a-46a7-910d-544b86862dce None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.029077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 441/883] 10.222.0.42 () {56 vars in 1149 bytes} [Tue May 3 16:09:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:28.035506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f360a7a-5abd-4dcc-a2de-c4f59abd2bc5 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.035506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f360a7a-5abd-4dcc-a2de-c4f59abd2bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.035506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f360a7a-5abd-4dcc-a2de-c4f59abd2bc5 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.035506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 442/884] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:28.035506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f360a7a-5abd-4dcc-a2de-c4f59abd2bc5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.070370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 443/885] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:27 2022] POST /identity/v3/services => generated 269 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:28.072482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.072844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.073216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.094013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:28.095393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:28.172520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f360a7a-5abd-4dcc-a2de-c4f59abd2bc5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.178842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 444/886] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:28.209288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.211101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11101f7-f425-4976-bd72-81518de11f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.213029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11101f7-f425-4976-bd72-81518de11f73 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.213029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11101f7-f425-4976-bd72-81518de11f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.213472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11101f7-f425-4976-bd72-81518de11f73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.296651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11101f7-f425-4976-bd72-81518de11f73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.298431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11101f7-f425-4976-bd72-81518de11f73 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.316219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62f59-dd45-41c6-8666-88dff0165dd5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.350926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.351771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.352052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.352326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.353342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.354719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-a2e9348d-af2d-4c8b-9546-1c18c8408b8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:28.366690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:28.367975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:28.369405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 445/887] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:28.370327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea822a6b-513e-4695-815a-e23dc1f1ff45 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.370931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea822a6b-513e-4695-815a-e23dc1f1ff45 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.370931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea822a6b-513e-4695-815a-e23dc1f1ff45 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.372439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 446/888] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:28.377021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea822a6b-513e-4695-815a-e23dc1f1ff45 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.405127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 443/889] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:09:28.410896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.411184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.411493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.428252 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:28.429447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:28.482098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea822a6b-513e-4695-815a-e23dc1f1ff45 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.497678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 444/890] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:28.498532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.535981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.536655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.536937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.537218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.537920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:28.538229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.539630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.549144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 447/891] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:28.549993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.608193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7878d58-6b1f-41c1-8caa-7f1ab16a17cd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.644530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.645715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.646415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.646979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.648961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea000e8-f119-414c-addc-278f93955a84 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.658885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.660371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:28.678036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:28.678947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:28.680180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:28.680180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:28.680180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:28.680180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:28.680180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 445/892] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:28.680180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.687804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.688608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.688892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.689167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.689821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.691218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:28.703236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:28.704235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:28.705609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 448/893] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:28.707459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.786942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f4719-e162-4e19-b495-9f387cc281fb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.803866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db5eb-b74b-408e-8e0e-1e4e44b6a64b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.821142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.821816 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.822094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.822399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.823055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:28.823381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.824753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.839295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 446/894] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:28.839295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.848610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.849292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:28.849574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:28.849850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:28.850583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:28.850887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:28.852332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:28.872353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 449/895] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:28.873872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:28.956819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef27829-ac0d-4ef1-b140-3433590176ad None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.982998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc120e3-b145-451f-a4df-509ad4f2dc02 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:28.999052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:28.999734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.000007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.000333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.000994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:29.001304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.002767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.012986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 447/896] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:29.014795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:29.029283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:29.030424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.030704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.030978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.040554 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.043084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:29.058487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:29.059747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:29.060643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:29.061343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 450/897] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:29.067915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:29.136690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675517-37d4-4910-8952-ba3e8f89eebb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:29.174071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:29.175054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.175790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.176273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.177128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:29.177576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.179098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.184676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 448/898] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:29.191422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea63f9-9fd2-45f6-b8e4-3711443afb3f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:29.191579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:29.224787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:29.225732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.226160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.226578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.228232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:29.228712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.230294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.249850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 451/899] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:29.251125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:29.300305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c938b14-b01b-4c4b-a015-2bbcde34d217 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:29.333890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:29.334657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.335047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.335460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.336349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] RBAC: Adding query filter params (interface=public, service_id=f95b3f5829c1422e8768bb7d9a7c1cd6, region_id=RegionOne) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:29.337346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.338946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.348860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 449/900] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:29 2022] GET /identity/v3/endpoints?service_id=f95b3f5829c1422e8768bb7d9a7c1cd6&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:29.350223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:29.357375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c7b5d-b212-4f63-8ae3-98cd8a3ba9bb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:29.392166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:29.393077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.393513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.393925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.394876 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] RBAC: Adding query filter params (role.id=b8adf967e2fc4fd3b05bba156f58e5c7, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=29989d1545154c4093f9c43c4c7abe37) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:29.395388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.397028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fccc39-3fc6-4e3d-8ed8-789fbc6d5227 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.411429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 452/901] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:29 2022] GET /identity/v3/role_assignments?user.id=29989d1545154c4093f9c43c4c7abe37&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=b8adf967e2fc4fd3b05bba156f58e5c7 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:29.458004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62a4a3-4ba4-4c0b-b9d1-aba9452676ec None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:29.496451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4f79-8290-4974-9612-892739750545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:29.497138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4f79-8290-4974-9612-892739750545 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:29.497426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4f79-8290-4974-9612-892739750545 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:29.497708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4f79-8290-4974-9612-892739750545 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:29.498395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d4f79-8290-4974-9612-892739750545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:29.502309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d4f79-8290-4974-9612-892739750545 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:29.514732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 450/902] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:29 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:09:30.393283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c391-7b76-4232-abde-b6ec999432aa None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:30.394003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c391-7b76-4232-abde-b6ec999432aa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:30.394003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c391-7b76-4232-abde-b6ec999432aa None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:30.395484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 453/903] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:30.400833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:30.401375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:30.401375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:30.418577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:30.419782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:30.488640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 451/904] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:30.520154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c391-7b76-4232-abde-b6ec999432aa None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:30.625432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c391-7b76-4232-abde-b6ec999432aa None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:30.659639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:30.660372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:30.660648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:30.660917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:30.661564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:30.662923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:30.676165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:30.677175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:30.678486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 454/905] 10.222.0.42 () {56 vars in 1132 bytes} [Tue May 3 16:09:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:30.684507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:30.783865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4334-1c87-4392-9ae6-adcf54ff0d44 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:30.817915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:30.818584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:30.818862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:30.819137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:30.819856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:30.820159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:30.822313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:30.827174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 452/906] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:30.832758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:30.938781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a5664-74d5-41a9-91c6-5fb470d56ea5 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:30.975808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:30.976476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:30.976908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:30.977185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:30.978857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:30.979166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:30.980555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec5fbf-6269-44e0-b9ff-cd60ef99411a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:30.986028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 455/907] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:30.991832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:31.094534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7941c2-f83a-4d08-9878-63e2a433e7cb None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:31.129227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:31.129890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.130170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.130444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.131233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] RBAC: Adding query filter params (interface=public, service_id=7dc25e8c15264566bbfba8f559ed25d9, region_id=RegionOne) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:31.131557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:31.132921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:31.137017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90818d2-6bb3-4430-874e-0081bf41f4b4 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.137306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90818d2-6bb3-4430-874e-0081bf41f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.137588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90818d2-6bb3-4430-874e-0081bf41f4b4 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 456/908] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:31.143566 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 453/909] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:30 2022] GET /identity/v3/endpoints?service_id=7dc25e8c15264566bbfba8f559ed25d9&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:31.144597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.144892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.145063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:31.145217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.162435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:31.163653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:31.235689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 457/910] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:31.254040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:31.261877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e41e1-9da8-43db-a836-196822f42f9a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:31.306848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da40d8-110a-47a1-bf72-60f8d21fa90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:31.307986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da40d8-110a-47a1-bf72-60f8d21fa90a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.308271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da40d8-110a-47a1-bf72-60f8d21fa90a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.308831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da40d8-110a-47a1-bf72-60f8d21fa90a None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.309515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da40d8-110a-47a1-bf72-60f8d21fa90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:31.311425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da40d8-110a-47a1-bf72-60f8d21fa90a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:31.319231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 454/911] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:31 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:09:31.362673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d6bc2-acf6-47cc-bd84-cdae80fe94c8 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:31.402407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e24ad-6fa6-4994-83cc-fe23dd8e2ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:31.403201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e24ad-6fa6-4994-83cc-fe23dd8e2ffc None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.403413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e24ad-6fa6-4994-83cc-fe23dd8e2ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.403665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e24ad-6fa6-4994-83cc-fe23dd8e2ffc None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.404420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e24ad-6fa6-4994-83cc-fe23dd8e2ffc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:31.405818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e24ad-6fa6-4994-83cc-fe23dd8e2ffc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:31.489295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 458/912] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:31 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:31.689024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249afbd0-180d-4ad5-a890-58e795705b2c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.689591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249afbd0-180d-4ad5-a890-58e795705b2c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.689591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249afbd0-180d-4ad5-a890-58e795705b2c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.691125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 455/913] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:31.697358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe433f-4b17-4e56-8f60-82f6e414d46b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.698012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe433f-4b17-4e56-8f60-82f6e414d46b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.698502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe433f-4b17-4e56-8f60-82f6e414d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.716321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d3fe433f-4b17-4e56-8f60-82f6e414d46b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:31.717826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d3fe433f-4b17-4e56-8f60-82f6e414d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:31.792974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 459/914] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:31.816067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249afbd0-180d-4ad5-a890-58e795705b2c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:31.866833 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dc9f-dcbf-4e10-89d8-b355710641b4 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.867168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dc9f-dcbf-4e10-89d8-b355710641b4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.870578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481dc9f-dcbf-4e10-89d8-b355710641b4 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.870578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 460/915] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:31.876460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.876866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.877242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.894452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:31.895949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:31.925163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249afbd0-180d-4ad5-a890-58e795705b2c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:31.960913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:31.962032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:31.962465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:31.962891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:31.971507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 461/916] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:31.973721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:31.982618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:31.983702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:31.984559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:31.985778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 456/917] 10.222.0.42 () {56 vars in 1120 bytes} [Tue May 3 16:09:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:31.990515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:31.991945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.091287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e2bb-afff-4f4b-ae21-4924e8e1ae48 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.094251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf639b24-75b7-4fcd-8376-798c3895fc26 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.125973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.126668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.126954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.127225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.128012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:32.128318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.129674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.130490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.131552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.132045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.132526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.133444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.135137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.142946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 462/918] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:09:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:32.143875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:32.148496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:32.150343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 16:09:32.151180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:32.158608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 457/919] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:32.160152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.246024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb830614-d19d-492e-8855-df59c4a13e20 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.264391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa500e-b8af-4206-9a0a-23b851dfcde8 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.282362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.283155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.283480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.283754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.295447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.296960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.301933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.302871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.303415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.303900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.304838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:32.305471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.307146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:32.314527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:32.315489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:32.316357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:32.316357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:32.316357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:32.316357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:32.316357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 463/921] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:32.316956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 458/921] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:32.319482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.323317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.422843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41210e5-8063-49ab-90f6-da501acfccbd None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.433267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497a9e-626f-4282-9ee7-271697d0d592 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.457232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.457897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.458177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.458452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.459151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:32.459484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.460843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.466553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 464/922] 10.222.0.42 () {56 vars in 1114 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:32.468934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.469603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.469890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.470178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.471002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:32.471363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.472215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.472780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.490158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 459/923] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:32.491529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.604376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b862d11-27d9-4d22-b79a-56bccbc0a40c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.613793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c8e1-8709-4363-b5e5-721dd27318a2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.638800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.639836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.640600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.641071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.642022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.643643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.649094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.650428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.650854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.651134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.659690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.661166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:32.677538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:32.678495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:32.679470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 460/924] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:32.685710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.738822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 465/925] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:09:32.804053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df34ba-46fb-431b-8714-46bf2304d81b None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:32.849938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:32.850620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:32.850947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:32.851225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:32.852190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:32.853003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:32.854551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:32.875178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 461/926] 10.222.0.42 () {56 vars in 1149 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:32.884437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:32.990868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0ad5-d5d0-4b4a-bc3e-49cb64eaee6f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:33.025631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:33.026836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.027356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.027854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.038719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:33.041116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:33.058396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:33.059395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:33.060310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:33.060310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:33.060310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:33.060310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:33.062566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 466/927] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:33.068310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:33.168898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5c13-cf90-4856-bad9-671682b53883 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:33.207936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:33.208599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.208878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.209265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.209981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:33.210329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:33.212493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:33.224694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 462/928] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:33.230367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:33.330415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987c71-d8f5-4edd-9ff2-95bc191ce46c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:33.364870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:33.365660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.365937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.366208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.373264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:33.374694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:33.389225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:33.390423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:33.391386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 467/929] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:33.398173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:33.504282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad64b70-2c34-442a-be5b-744cdb482c26 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:33.544035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:33.544708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.544997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.545278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.546070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:33.546385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:33.547854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b4154-55c1-483a-a8ec-72e8fe996298 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:33.561514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 463/930] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:33.567425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:33.678460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a0e5c-a108-4b0a-b553-c94de03dca4e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:33.703056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab42f-dbc7-4f94-9013-e84768b68ba4 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.703403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab42f-dbc7-4f94-9013-e84768b68ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.703684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fab42f-dbc7-4f94-9013-e84768b68ba4 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.705382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 464/931] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:33.710618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.710904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.711185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.723523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af780a71-75e9-472b-9f71-cd202d4c59ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:33.723523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af780a71-75e9-472b-9f71-cd202d4c59ee None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.723523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af780a71-75e9-472b-9f71-cd202d4c59ee None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.723523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af780a71-75e9-472b-9f71-cd202d4c59ee None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/29989d1545154c4093f9c43c4c7abe37/roles/b8adf967e2fc4fd3b05bba156f58e5c7` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.725402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af780a71-75e9-472b-9f71-cd202d4c59ee None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=29989d1545154c4093f9c43c4c7abe37, role_id=b8adf967e2fc4fd3b05bba156f58e5c7)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:33.727001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af780a71-75e9-472b-9f71-cd202d4c59ee None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:33.729090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:33.730280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:33.803345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 465/932] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:33.823168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:33.867732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 468/933] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:33 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/29989d1545154c4093f9c43c4c7abe37/roles/b8adf967e2fc4fd3b05bba156f58e5c7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:33.869733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cf71c-cb23-43e8-99b2-6ea1c86e912c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.870018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cf71c-cb23-43e8-99b2-6ea1c86e912c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.870292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cf71c-cb23-43e8-99b2-6ea1c86e912c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.871960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 469/934] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:33.879015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:33.879469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:33.879843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:33.902602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:33.904652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:33.962336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0975f5-a687-4a91-903f-b8370513b7e6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.003557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 470/935] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:34.009268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.010132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.010414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.010692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.011452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.012853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:34.026636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:34.027703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 16:09:34.028978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:34.030668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.030812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 466/936] 10.222.0.42 () {56 vars in 1132 bytes} [Tue May 3 16:09:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:34.034232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.151012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b674-2456-404c-b3c7-445136d3aca3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.157377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f71ea-3c1e-4a2b-9cfa-0160d5320576 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.185194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.185998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.186339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.186539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.187180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.188561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:34.200388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:34.201409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:34.202267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 471/937] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:34.204135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.205033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.205515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.206083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.207145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:34.207749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.207938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.209616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.216706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 467/938] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:34.222526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.319680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44d9a-9854-4971-8b4e-ef378a50d995 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.326518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45635c-0544-4eec-b281-86c475cba531 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.354821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.355507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.355793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.356065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.356759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:34.357057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.358549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.363508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.364444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.364959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.365441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.366346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:34.366869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.367953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 472/939] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:34.368817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.368928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.379162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 468/940] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:34.380390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.470173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb4f40-ca87-49ec-832d-64dcfe62d012 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.484420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca99ac-ab4b-49bb-a760-9fbe9c18bd16 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.504457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.505121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.505399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.505668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.506643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:34.506643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.508082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.518542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 473/941] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:34.519745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.523293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.524873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.525381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.525826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.526720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.528266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.621348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2eb24-51c8-40cd-9b4f-c22f92ffd40c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.663891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 469/942] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:34.673466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.674664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.675379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.675932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.677060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] RBAC: Adding query filter params (interface=public, service_id=eb471aa739824b8d932bf8d788371a07, region_id=RegionOne) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:34.677591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.679369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91b736-792d-4c41-a6cf-062022299dd9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.688589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 474/943] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/endpoints?service_id=eb471aa739824b8d932bf8d788371a07&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:34.704905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:34.823837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791654b-b5eb-4cf1-9768-ecd7f7a09d3e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:34.860277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae868f-3226-49fc-98b5-8ce4ff46e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:34.860945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae868f-3226-49fc-98b5-8ce4ff46e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:34.861227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae868f-3226-49fc-98b5-8ce4ff46e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:34.861546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae868f-3226-49fc-98b5-8ce4ff46e8c8 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:34.862233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae868f-3226-49fc-98b5-8ce4ff46e8c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:34.863749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae868f-3226-49fc-98b5-8ce4ff46e8c8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:34.870325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 470/944] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:34 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:09:35.139067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c3d6-a764-4685-89c8-7f2e1b6c98e0 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:35.139430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c3d6-a764-4685-89c8-7f2e1b6c98e0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:35.139607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c3d6-a764-4685-89c8-7f2e1b6c98e0 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:35.141424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 475/945] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:35.146702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:35.146993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:35.147283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:35.164269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:35.165486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:35.238432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 471/946] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:35.261721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c3d6-a764-4685-89c8-7f2e1b6c98e0 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:35.362111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c3d6-a764-4685-89c8-7f2e1b6c98e0 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:35.395940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:35.396555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:35.396847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:35.397115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:35.397859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:35.399307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:35.400717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING keystone.server.flask.common [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 16:09:35.460521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.sql.core [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 16:09:35.460521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 16:09:35.460521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [parameters: {'id': '03a307a8a77f4adab09122323e444afd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 16:09:35.460521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80029) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03a307a8a77f4adab09122323e444afd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03a307a8a77f4adab09122323e444afd. May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application result = self._query(query) May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application conn.query(q) May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 16:09:35.478277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application result.read() May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 16:09:35.480209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application next(self.gen) May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application yield resource May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application next(self.gen) May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self.session.rollback() May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self.force_reraise() May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise self.value May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application session.commit() May 03 16:09:35.482570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._prepare_impl() May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self.session.flush() May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._flush(objects) May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application compat.raise_( May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application flush_context.execute() May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 16:09:35.484642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rec.execute(self) May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 16:09:35.486719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application result = self._query(query) May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application conn.query(q) May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application result.read() May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 16:09:35.492006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [parameters: {'id': '03a307a8a77f4adab09122323e444afd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:35.494016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:35.495013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03a307a8a77f4adab09122323e444afd. May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:35.496157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 476/947] 10.222.0.42 () {60 vars in 1140 bytes} [Tue May 3 16:09:35 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:35.496703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:35.597841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dbc6d-3c73-4e9e-bfcb-cccee0354ef1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:35.634241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:35.635466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:35.635957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:35.636427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:35.643882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:35.645568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-4a466ef5-6631-426e-ae2e-2a1717ec56ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:35.659506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:35.660383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:35.661299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:35.668926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 472/948] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:35.670764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:35.780947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7380-5fe1-473c-814c-d6c5bcd8f9da None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:35.823461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:35.824503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:35.825034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:35.825516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:35.826472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:35.826984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:35.828845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efefed-bdae-4858-a80f-1bd5e19fb03b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:35.855417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 477/949] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:36.240612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932c88-f350-42ee-bf7c-defe3c2c0dbd None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:36.241134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932c88-f350-42ee-bf7c-defe3c2c0dbd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:36.241134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31932c88-f350-42ee-bf7c-defe3c2c0dbd None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:36.242782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 473/950] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:36.247998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:36.248290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:36.248570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:36.268557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:36.270051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:36.340377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 478/951] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:36.363346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932c88-f350-42ee-bf7c-defe3c2c0dbd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:36.466756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31932c88-f350-42ee-bf7c-defe3c2c0dbd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:36.501567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:36.502301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:36.502628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:36.502908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:36.514024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:36.522201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:36.523157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:36.524660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 474/952] 10.222.0.42 () {56 vars in 1120 bytes} [Tue May 3 16:09:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:36.529801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:36.627357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4deb21-1b6b-42a1-b0d5-6e4319450830 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:36.661559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:36.662235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:36.662511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:36.662782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:36.663559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:36.663862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:36.665933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:36.674727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 479/953] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:09:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:36.680315 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:36.783127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e1c4e-20c6-4512-98bd-52b5caef8fa0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:36.818389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:36.819699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:36.820232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:36.820513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:36.835049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:36.837113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-89308471-f321-4ca8-868a-a6161f130f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:36.857428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:36.858520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:36.859493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:36.859493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:36.859493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:36.859493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:36.859493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 475/954] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:36.865791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:36.967056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da74d38-6ee3-40ba-8959-d8af45a3fad3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.001129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.002169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.002675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.003150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.004177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:37.004699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.006251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.020237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a0d0-3401-4415-b206-64155d8031b1 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.020846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a0d0-3401-4415-b206-64155d8031b1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.021351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a0d0-3401-4415-b206-64155d8031b1 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.021758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 480/955] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:37.023414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 476/956] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:37.028208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.032515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.032742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.033192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.052754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:37.054350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:37.126213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 477/957] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:37.138198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c848-cb3d-40c1-9b03-284efc41c11a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.150583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.183357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.185154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.185625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.186268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.197060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.198732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:37.216195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:37.217258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 16:09:37.218547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:37.222307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 481/958] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:37.223240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.276791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39fd43-15a2-4900-a8d1-3a0f2b517a52 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.310672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.311424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.311710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.311991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.312644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.314015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.325488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f069-4236-43be-98b2-7553c5c67f0c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6af1eda1-ca70-4933-815f-ed1705a9cec5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:37.326156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:37.327109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:37.328004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 478/959] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:37.329327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8bc6d-9edc-4508-93aa-08ed71f77486 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.329327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8bc6d-9edc-4508-93aa-08ed71f77486 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.329582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8bc6d-9edc-4508-93aa-08ed71f77486 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.330902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 479/960] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:37.333346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8bc6d-9edc-4508-93aa-08ed71f77486 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.365697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.366366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.366650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.366926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.368370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:37.368680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.370099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a782ca-24d5-4993-b4d0-1bad3a91ad96 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.392907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 482/961] 10.222.0.42 () {56 vars in 1149 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:37.392907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.392907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.392907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.406156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:37.407361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:37.440299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8bc6d-9edc-4508-93aa-08ed71f77486 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.483279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 483/962] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:37.483505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.483619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.483715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.483715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.483715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.483715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:37.483715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.483715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.493828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 480/963] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:37.494778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.590478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a8eb-98d4-405e-a8c6-0b57983d315a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.606391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c329dc-3d4d-4e0d-be44-d0b12f40e7e1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.624080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.624737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.625022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.625300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.639580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.640508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.640794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.641076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.641774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:37.642079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.643475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.655313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 481/964] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:37.655313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.737336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.738943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.770388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5445f48-6038-4e5b-8d41-bae88be44f3a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.809897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.811088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.811555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:37.811974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:37.812786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:37.814424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:37.831034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:37.832338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:37.833187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:37.841180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 482/965] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:37.842323 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.868487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 484/966] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:09:37.869561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:37.962726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6702e-54ab-44d5-81eb-d42d1dafcad0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:37.998170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:37.999170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:37.999650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.000114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.000992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:38.001472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.003125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.006873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbd783-1bab-49aa-bad0-b5a9ec543397 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.008453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 483/967] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:38.016758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.046693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.047907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.048389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.048856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.060021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.061741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:38.079755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:38.080693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:38.081636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:38.081636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:38.081636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:38.081636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:38.089425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 485/968] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:38.090671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.120369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049caa34-27b0-41aa-8c72-dcca2e096108 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.154291 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.154951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.155229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.155533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.156229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:38.156530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.157898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.163283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 484/969] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:38.169439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.209023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27979c-c2b2-4cab-844d-d8f869461c10 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.247137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.248225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.248723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.249196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.250123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:38.250640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.252227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.269057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 486/970] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:38.270196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.274887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d7ce7-8ce1-45e4-9b1d-7242f9b10c10 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.310891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea60a7-aa9d-4bda-888e-370fdc4c56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.311595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea60a7-aa9d-4bda-888e-370fdc4c56eb None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.311854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea60a7-aa9d-4bda-888e-370fdc4c56eb None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.312121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea60a7-aa9d-4bda-888e-370fdc4c56eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.312857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea60a7-aa9d-4bda-888e-370fdc4c56eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.314790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea60a7-aa9d-4bda-888e-370fdc4c56eb None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.377993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a8fcb-0ba1-46b3-a837-2c29c6c95180 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.411054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.419686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 485/971] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:38.419894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.419894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.419894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.420151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a8c5-0f4e-4825-8912-78323f6a7cc9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.420151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a8c5-0f4e-4825-8912-78323f6a7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.420151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a8c5-0f4e-4825-8912-78323f6a7cc9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.420151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 486/972] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:38.425317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.425617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.426019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.428298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.429783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.445035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:38.447610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:38.448860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:38.449926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:38.450909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 487/973] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:38.456141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.563296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 487/974] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:38.588644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70958-c226-454e-b0b1-df2f6896980a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.592577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.636082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.636842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.637186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.637527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.638379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:38.638759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.640543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.653675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 488/975] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:38.659679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.711979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd14a8-5d78-4bd6-b437-170475d12406 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.755277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.756463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.756897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.757465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.759240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.761366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.763453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING keystone.server.flask.common [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 16:09:38.767673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196794fd-8bff-48e1-b944-dabde5a66ebc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.801300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.802070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.802445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.802721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.803565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] RBAC: Adding query filter params (role.id=b8adf967e2fc4fd3b05bba156f58e5c7, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=29989d1545154c4093f9c43c4c7abe37) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:38.803868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:38.805999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:38.808998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.sql.core [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 16:09:38.808998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 16:09:38.808998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [parameters: {'user_id': 'c6dc5fc0a3444a6fa6c60f5ba9769592', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 16:09:38.808998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80030) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 16:09:38.815356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 489/976] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:38 2022] GET /identity/v3/role_assignments?user.id=29989d1545154c4093f9c43c4c7abe37&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=b8adf967e2fc4fd3b05bba156f58e5c7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result = self._query(query) May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application conn.query(q) May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result.read() May 03 16:09:38.819404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 16:09:38.820551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application next(self.gen) May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application yield resource May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application next(self.gen) May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.session.rollback() May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.force_reraise() May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise self.value May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application session.commit() May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 16:09:38.822258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._prepare_impl() May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.session.flush() May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._flush(objects) May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application compat.raise_( May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application flush_context.execute() May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rec.execute(self) May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 16:09:38.823643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 16:09:38.824734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result = self._query(query) May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application conn.query(q) May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application result.read() May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 16:09:38.825772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c6dc5fc0a3444a6fa6c60f5ba9769592', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:38.827436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 16:09:38.828511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:38.829616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 488/977] 10.222.0.42 () {60 vars in 1131 bytes} [Tue May 3 16:09:38 2022] POST /identity/v3/users => generated 160 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:38.830115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:38.950736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1b7e8-1530-4026-935b-e6bd540c2d5c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:38.987863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:38.988868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:38.989367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:38.989750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:38.999542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:39.001164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-57693cf4-b25f-46dc-87ed-906a1287caa4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:39.017246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:39.018457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:39.019600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 490/978] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:39.025339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:39.127954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848030a8-0587-44a4-8fdc-cc5b1fdbd0a1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:39.167122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:39.167841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:39.168125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:39.168450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:39.169267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:39.169574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:39.171202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49e767-65c8-46e1-8fe6-7e87c6d5fcb3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:39.211107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 489/979] 10.222.0.42 () {56 vars in 1101 bytes} [Tue May 3 16:09:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:39.981845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0dda-7b48-4b5d-9418-f61b91781387 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:39.982401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0dda-7b48-4b5d-9418-f61b91781387 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:39.982401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0dda-7b48-4b5d-9418-f61b91781387 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:39.983930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 491/980] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:39.989923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41d7f3-04c8-4b9e-8041-9f6ac9fee3b5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:39.990359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41d7f3-04c8-4b9e-8041-9f6ac9fee3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:39.990559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41d7f3-04c8-4b9e-8041-9f6ac9fee3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:40.008669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bb41d7f3-04c8-4b9e-8041-9f6ac9fee3b5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:40.010214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bb41d7f3-04c8-4b9e-8041-9f6ac9fee3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:40.077459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 490/981] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:40.100335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe0dda-7b48-4b5d-9418-f61b91781387 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:40.198460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe0dda-7b48-4b5d-9418-f61b91781387 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:40.230961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6b43-b109-487b-9500-1f7e27e1d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:40.231644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6b43-b109-487b-9500-1f7e27e1d1a8 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:40.231970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6b43-b109-487b-9500-1f7e27e1d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:40.232194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6b43-b109-487b-9500-1f7e27e1d1a8 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:40.232896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6b43-b109-487b-9500-1f7e27e1d1a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:40.234240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6b43-b109-487b-9500-1f7e27e1d1a8 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:40.319299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 492/982] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:40 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:09:40.789295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cbb37-cd90-4793-9627-a4b576f60c7d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:40.789649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cbb37-cd90-4793-9627-a4b576f60c7d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:40.790021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cbb37-cd90-4793-9627-a4b576f60c7d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:40.791509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 491/983] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:40.796468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:40.796827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:40.797168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:40.813742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:40.814894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:40.885272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 493/984] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:40.908105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cbb37-cd90-4793-9627-a4b576f60c7d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.015161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cbb37-cd90-4793-9627-a4b576f60c7d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.049359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.050080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.050359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.050629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.051286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.052653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-edcc1ece-7cd4-44ba-88dc-7fa2fcc5ce97 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:41.065041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:41.066145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:41.067067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:41.071133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 492/985] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:41.072490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.157096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d94f5d-6dd2-4ea0-b011-e7a1c8d35969 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.157394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d94f5d-6dd2-4ea0-b011-e7a1c8d35969 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.157653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d94f5d-6dd2-4ea0-b011-e7a1c8d35969 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.159923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 493/986] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:41.164888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.165195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.165468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.170390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0b18-2a41-4a4a-93e8-ea4f2d28ed6f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.185686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:41.186854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:41.205062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.205729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.206007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.206280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.206992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:41.207349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.208665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.218635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 494/987] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:41.219611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.258772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 494/988] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:41.281468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.319066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f753364-6354-4a1f-a8c4-fe8f829f7ad8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.356438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.357097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.357375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.357655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.358345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:41.358644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.360022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.364869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 495/989] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:41.371723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.378386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1461e76-adfb-4978-b984-d766a09184d3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.412250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.413039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.413324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.413590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] PATH_INFO: `/v3/services/image` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.414755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.416234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:41.427609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:41.428815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:41.429862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 495/990] 10.222.0.42 () {56 vars in 1105 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:41.434953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.480656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f49f2-54d7-4fc9-87de-96bfbf9bd6b8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.518061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.518721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.519005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.519297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.520093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] RBAC: Adding query filter params (interface=admin, service_id=eb471aa739824b8d932bf8d788371a07, region_id=RegionOne) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:41.520403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.521759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.531733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 496/991] 10.222.0.42 () {56 vars in 1249 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/endpoints?service_id=eb471aa739824b8d932bf8d788371a07&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:41.532683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.554332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0998d7-05d4-4667-b1aa-4e700b2af4bf None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.590542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.591308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.591592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.592172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.593143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] RBAC: Adding query filter params (name=image) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:41.593448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.594948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.605741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 496/992] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:41.606774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:41.629897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ff743-5c52-4b29-86ce-ed5007943e1b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.663664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b019e-4d2a-4824-b47a-6fd2a361dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.664357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b019e-4d2a-4824-b47a-6fd2a361dd83 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.664642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b019e-4d2a-4824-b47a-6fd2a361dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.664937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b019e-4d2a-4824-b47a-6fd2a361dd83 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.665596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b019e-4d2a-4824-b47a-6fd2a361dd83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.666955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b019e-4d2a-4824-b47a-6fd2a361dd83 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.673108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 497/993] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:09:41.717784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eafd9-ff93-4533-9a55-791b41f4dcaf None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:41.752920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:41.753602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:41.753882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:41.754153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:41.754859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] RBAC: Adding query filter params (type=image) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:41.755161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:41.756585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6e099-84fc-4406-b66e-43dd8ac1779e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:41.762411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 497/994] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:42.622262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead4fc9-745a-4ac5-bdf9-0fb718d90303 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:42.622782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead4fc9-745a-4ac5-bdf9-0fb718d90303 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:42.622782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead4fc9-745a-4ac5-bdf9-0fb718d90303 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:42.624376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 498/995] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:42.629215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:42.629608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:42.629770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:42.646431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:42.647623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:42.712555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 498/996] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:42.735435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead4fc9-745a-4ac5-bdf9-0fb718d90303 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:42.835439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead4fc9-745a-4ac5-bdf9-0fb718d90303 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:42.868807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:42.869597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:42.869878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:42.870150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:42.870788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:42.872170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:42.884062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:42.885246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:42.886122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:42.893862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 499/997] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:42.894068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:42.988555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f5580-4182-41bf-91ff-a2242bf9e9cb None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:43.021490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:43.022515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:43.022984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:43.024099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:43.025086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:43.025578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:43.027141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:43.032264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 499/998] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:43.037567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:43.134550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d6760-59db-4f83-9ab9-f079f9344636 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:43.168335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:43.168999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:43.169285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:43.169563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:43.170259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:43.170566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:43.171946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:43.181771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 500/999] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:43.182727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:43.283468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff14155-66b9-425c-a32b-57f56f50d1f1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:43.316107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:43.316763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:43.317046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:43.317318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:43.318099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] RBAC: Adding query filter params (interface=public, service_id=49c2ac89fcb74796a69629aa2dd9ec65, region_id=RegionOne) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:43.318409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:43.319806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351917-ddaa-4b89-8ff3-b9fb3fc379c9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:43.325835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 500/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:43 2022] GET /identity/v3/endpoints?service_id=49c2ac89fcb74796a69629aa2dd9ec65&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:43.331218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:43.430441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd35fb-a52a-45e8-9950-3291eab45871 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:43.462880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243daa0-85d8-4522-90fb-f01edc16bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:43.463564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243daa0-85d8-4522-90fb-f01edc16bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:43.463845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243daa0-85d8-4522-90fb-f01edc16bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:43.464117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243daa0-85d8-4522-90fb-f01edc16bbc2 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:43.464787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243daa0-85d8-4522-90fb-f01edc16bbc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:43.466132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243daa0-85d8-4522-90fb-f01edc16bbc2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:43.475764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 501/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:43 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:09:43.939832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ed965-0e3d-4b33-8eb3-ea6ac8a602de None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:43.940399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ed965-0e3d-4b33-8eb3-ea6ac8a602de None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:43.940399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ed965-0e3d-4b33-8eb3-ea6ac8a602de None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:43.941873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 501/1002] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:43.947119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:43.947586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:43.947744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:43.964410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:43.965582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:44.028114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344c23-6286-4c15-8a9a-5e07d086e1a2 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.028407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344c23-6286-4c15-8a9a-5e07d086e1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.028686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16344c23-6286-4c15-8a9a-5e07d086e1a2 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.030186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 502/1003] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:44.031795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 502/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:44.035293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.035577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.035861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.052682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:44.053859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:44.055534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:44.126767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 503/1005] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:44.150360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:44.151109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eae7b-139a-4660-9c5e-5834ce1a6d43 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:44.186269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:44.187081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.187387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.187664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.188311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:44.189664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:44.201462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:44.202468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:44.203440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 503/1006] 10.222.0.42 () {56 vars in 1126 bytes} [Tue May 3 16:09:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:44.208340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:44.256031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a421c2-aaac-442d-ab72-083f55486823 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:44.290683 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:44.291373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.291654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.291927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.292646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:44.294010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:44.310348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15576dd4-b447-43e6-89c6-26575b95989f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:44.343230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:44.343915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.344195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.344469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.345161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:44.345462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:44.346813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:44.353361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 504/1007] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:44.358846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:44.411172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 504/1008] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:44 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:09:44.462935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea142419-adde-4ead-bcc3-e19b6940555b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:44.508875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:44.510349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.510349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.510349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.513057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:44.513057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:44.513057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f69aa-5da2-45b5-99bc-2c42b8cfdea1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:44.525405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 505/1009] 10.222.0.42 () {56 vars in 1122 bytes} [Tue May 3 16:09:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:44.526601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:44.632460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad09d-6197-4b21-a071-3ce8375f4b23 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:44.667512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1aee0-880a-4f52-92c9-4ed11bb3fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:44.668255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1aee0-880a-4f52-92c9-4ed11bb3fbfe None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:44.668536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1aee0-880a-4f52-92c9-4ed11bb3fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:44.668809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1aee0-880a-4f52-92c9-4ed11bb3fbfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:44.669547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1aee0-880a-4f52-92c9-4ed11bb3fbfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:44.670893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1aee0-880a-4f52-92c9-4ed11bb3fbfe None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:44.748793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 505/1010] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:09:45.764781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274225a-3b32-458f-9055-a95c6b2a0a62 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:45.765275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274225a-3b32-458f-9055-a95c6b2a0a62 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:45.765275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274225a-3b32-458f-9055-a95c6b2a0a62 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:45.766673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 506/1011] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:45.771759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:45.772180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:45.772356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:45.789020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:45.790214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:45.867436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 506/1012] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:45 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:45.885539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274225a-3b32-458f-9055-a95c6b2a0a62 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:45.983700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274225a-3b32-458f-9055-a95c6b2a0a62 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:46.016006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:46.016717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:46.016996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:46.017268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:46.017901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:46.019242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:46.030666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:46.031701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:46.037790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 507/1013] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:46.038627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:46.132454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ca263-c2f0-41da-b7c1-93fed5bc9703 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:46.166005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:46.166664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:46.166946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:46.167224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:46.167946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] RBAC: Adding query filter params (name=compute) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:46.168251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:46.169614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:46.174517 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 507/1014] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:46.180960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:46.279422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5f58-3adc-4ebb-9f7a-dbc975ac4eb9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:46.314041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:46.314709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:46.314998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:46.315295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:46.316032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] RBAC: Adding query filter params (type=compute) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:46.316339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:46.317695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c572ce2-99a1-447a-ab1d-e98d4cb8e2df None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:46.327602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 508/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Tue May 3 16:09:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:46.328749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:46.430394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7680f-f069-42bc-bca3-b7e2bbb728ba None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:46.463807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436790c-0d07-4388-856e-3be9da40fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:46.464469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436790c-0d07-4388-856e-3be9da40fb1c None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:46.464755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436790c-0d07-4388-856e-3be9da40fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:46.465033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436790c-0d07-4388-856e-3be9da40fb1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:46.465771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436790c-0d07-4388-856e-3be9da40fb1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:46.467168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436790c-0d07-4388-856e-3be9da40fb1c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:46.628376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 508/1016] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:46.732889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee3ca4-b9fe-4009-8557-b2f7a4c34386 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:46.733242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee3ca4-b9fe-4009-8557-b2f7a4c34386 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:46.733452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee3ca4-b9fe-4009-8557-b2f7a4c34386 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:46.734848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 509/1017] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:46.740685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03615ca9-f801-4098-8418-07ab923b0b68 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:46.740984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03615ca9-f801-4098-8418-07ab923b0b68 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:46.741266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03615ca9-f801-4098-8418-07ab923b0b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:46.760171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-03615ca9-f801-4098-8418-07ab923b0b68 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:46.761379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-03615ca9-f801-4098-8418-07ab923b0b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:46.841379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 509/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:46.864645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee3ca4-b9fe-4009-8557-b2f7a4c34386 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:46.975020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee3ca4-b9fe-4009-8557-b2f7a4c34386 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.004630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017b14-cd9b-42d5-93cb-c9a16a9ea2cf None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.004966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017b14-cd9b-42d5-93cb-c9a16a9ea2cf None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.005188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017b14-cd9b-42d5-93cb-c9a16a9ea2cf None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.006738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 510/1019] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:47.009690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.010478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.010761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.011095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] PATH_INFO: `/v3/services/image` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.011456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.011747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.011860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.012027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.013196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:47.025485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:47.026754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:47.027963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 510/1020] 10.222.0.42 () {56 vars in 1105 bytes} [Tue May 3 16:09:46 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:47.032576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:47.033733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:47.034904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:47.102354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 511/1021] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:47.125674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:47.131269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76905f-e4d5-428d-922b-0a0f634be967 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.164570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.165224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.165502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.165775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.166469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] RBAC: Adding query filter params (name=image) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:47.166770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.168160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.177667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 511/1022] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:47.178423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:47.228146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a205464-a071-47cc-9b87-8d03adaf5ac5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.260730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.261516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.261801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.262067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.263219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.264907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.266670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 512/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:47.272218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:47.277966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f09428-2200-417d-a62c-6a69467ca927 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.314283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.315175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.315664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.316092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.316950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] RBAC: Adding query filter params (type=image) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:47.317406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.318910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.328894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 512/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:47.330085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:47.368671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d4d-24d6-46f2-b4de-0105b4c82bad None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.404881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fca54-530d-4d16-a6a1-e8b907b6abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.405540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fca54-530d-4d16-a6a1-e8b907b6abfa None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.405817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fca54-530d-4d16-a6a1-e8b907b6abfa None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.406085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fca54-530d-4d16-a6a1-e8b907b6abfa None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.406776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fca54-530d-4d16-a6a1-e8b907b6abfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.408234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fca54-530d-4d16-a6a1-e8b907b6abfa None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.432199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53abe1-6d04-4058-95ae-564140953876 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.465688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.466341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.466618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.466886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.467714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] RBAC: Adding query filter params (interface=public, service_id=59483f40415a4603aced3e6642cdb37f, region_id=RegionOne) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:47.468019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.469393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.474181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 513/1025] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:09:47 2022] GET /identity/v3/endpoints?service_id=59483f40415a4603aced3e6642cdb37f&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:47.479753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:47.523931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 513/1026] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:09:47 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:47.590869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f07e-a241-421b-9a20-3d22eebfeb1c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:47.626108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245b690-974d-49ab-b5b3-e28263e78432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:47.626789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245b690-974d-49ab-b5b3-e28263e78432 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:47.627072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245b690-974d-49ab-b5b3-e28263e78432 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:47.627378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245b690-974d-49ab-b5b3-e28263e78432 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:47.628062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245b690-974d-49ab-b5b3-e28263e78432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:47.629440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245b690-974d-49ab-b5b3-e28263e78432 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:47.637348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 514/1027] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:09:47 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:09:49.032958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d74a4-494e-4122-9bcb-31f1e413ceeb None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.033483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d74a4-494e-4122-9bcb-31f1e413ceeb None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.033572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d74a4-494e-4122-9bcb-31f1e413ceeb None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.034865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 514/1028] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:49.040320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.040773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.040863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.057052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:49.058212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:49.125653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 515/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:49.149922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d74a4-494e-4122-9bcb-31f1e413ceeb None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:49.254222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d74a4-494e-4122-9bcb-31f1e413ceeb None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:49.288296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:49.289098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.289378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.289654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.300069 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:49.308797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:49.309736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:49.310612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 515/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Tue May 3 16:09:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:49.317298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:49.413999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8effa-159b-46d7-afb5-11e43e72d47a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:49.448460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:49.449452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.449897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.455406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.455406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:49.455406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:49.455406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:49.467340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 516/1031] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:09:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:49.468631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:49.573782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc4a0b-434b-4a0c-b3b9-2d566345bcfe None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:49.607724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:49.608895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.609446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.609921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.621043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:49.622783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:49.642614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:49.643668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:49.644588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:49.644588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:49.644588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:49.644588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:49.652809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:49.664217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 516/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:49.762497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0120d5-b524-44b4-b99e-3886f6d13da6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:49.797662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:49.798716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.799198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.799695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.800619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:49.801180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:49.802792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a0c0e-a36c-4e42-83b8-258ca76a732e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:49.822260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:49.833562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 517/1033] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:49.842729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c2fb-ff93-438e-81fd-3f85248677c2 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.843041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c2fb-ff93-438e-81fd-3f85248677c2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.843320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c2fb-ff93-438e-81fd-3f85248677c2 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.847393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 518/1034] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:49.849794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5fcc-c7af-4502-b4de-cbfd0e460598 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.850084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5fcc-c7af-4502-b4de-cbfd0e460598 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.850363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5fcc-c7af-4502-b4de-cbfd0e460598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.871581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-fa2d5fcc-c7af-4502-b4de-cbfd0e460598 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:49.872783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fa2d5fcc-c7af-4502-b4de-cbfd0e460598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:49.932332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694a4d-c5a3-46f8-a53d-7675f22b51a9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:49.946781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 519/1035] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:49.948133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea37697-2299-4913-8f58-6478d1886d61 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.948431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea37697-2299-4913-8f58-6478d1886d61 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.948710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea37697-2299-4913-8f58-6478d1886d61 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.950175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 520/1036] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:49.956726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.957014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.957293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.966739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:49.967565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:49.967849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:49.968125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:49.974403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:49.975633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:49.978475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:49.979956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:49.994757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:49.995901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 517/1037] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:49.997279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.043808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 521/1038] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:50.044641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.091687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261894ec-0431-443d-8c84-fe8c6b2e1501 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.123187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.123993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.124273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.124544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.125689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.127102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.128739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 518/1039] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:50.129485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.141319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1fa99-d8b9-4d47-908e-0fc767159f3d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.175270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.175930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.176210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.176484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.177310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:50.177618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.179032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.196324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 522/1040] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:50.197086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.225107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542d34-3d8a-4a66-8661-88b683ac2aa8 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.257118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.257897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.258173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.258446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.259080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.260469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:50.271917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:50.273621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:50.274530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 519/1041] 10.222.0.42 () {56 vars in 1105 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:50.275996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.296541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831795ad-5bb6-41af-a5a2-01d377d4c2c8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.330013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.330670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.330951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.331224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.331940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.333352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.372782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30a7b2-21ae-4756-a51d-7759c89a41a9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.405385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.406009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.406290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.406561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.454045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 523/1042] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:09:50 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:50.454948 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.472348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.473942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.575611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205e57f-1613-4e40-b0eb-76e345d5df18 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.586255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 520/1043] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:09:50.587471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.611769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.612453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.612823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.613012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.613713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:50.614008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.615452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.620892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 524/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:50.626727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.690994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083844-df4a-47ff-a8f9-fe31475cd863 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.725362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.726687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.726980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.727287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.731621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe18767-869c-416e-a163-f86db94357b2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.737549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.739027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:50.757145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:50.758125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:50.759020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:50.759020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:50.759020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:50.759020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:50.764752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 521/1045] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:50.765815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.766266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.766930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.767213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.767519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.768218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] RBAC: Adding query filter params (type=image) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:50.768524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.769980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.779331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 525/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:50.781779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:50.864338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ba568-7a00-4ae0-b24d-f0cd521f5a81 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.881022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a346-bd1e-4f65-9748-cce53b27c628 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:50.898552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.899227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.899535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.899811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.900551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:50.900860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.902235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.914360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 522/1047] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:50.915384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:50.916044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:50.916321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:50.916596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:50.917320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:50.918725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:50.919729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:51.014739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae09cae-2fc1-4327-a269-285456e7b986 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:51.022218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 526/1048] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:09:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:09:51.057936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:51.058778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:51.059066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:51.059374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:51.067081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:51.068708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:51.084123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:51.085129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:51.087127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:51.092609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 523/1049] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:51.093694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:51.200161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665d68-0471-4870-9f37-caa8766db851 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:51.235648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:51.235965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:51.236244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:51.236514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:51.237290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:51.237596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:51.239006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da07ab-39ce-42a7-9410-39efc6df5133 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:51.251387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 527/1050] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:51.257757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:51.356277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f541f0-e4de-4cb7-90c3-ca9ae840c955 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:51.390301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:51.390959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:51.391244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:51.391564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:51.392392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] RBAC: Adding query filter params (role.id=b8adf967e2fc4fd3b05bba156f58e5c7, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=7bc226da24944f578dd20785b5bcece6) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:51.392709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:51.394132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa16d3-0803-4596-9ab4-1994a239ff1e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:51.399940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 524/1051] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:51 2022] GET /identity/v3/role_assignments?user.id=7bc226da24944f578dd20785b5bcece6&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=b8adf967e2fc4fd3b05bba156f58e5c7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:52.768707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d692a-c67f-4e93-b60a-d48e19fec24b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:52.769209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d692a-c67f-4e93-b60a-d48e19fec24b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:52.769209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d692a-c67f-4e93-b60a-d48e19fec24b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:52.770687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 528/1052] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:52.775843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:52.776243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:52.776407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:52.793588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:52.794755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:52.862134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 525/1053] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:52.886056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d692a-c67f-4e93-b60a-d48e19fec24b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:52.987545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d692a-c67f-4e93-b60a-d48e19fec24b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:53.022071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:53.022860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.023144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.023590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.033501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:53.041662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:53.042625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:53.043975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:53.047592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 529/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:53.049017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.156445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd5290-4f96-4792-9353-5a29972e9f8e None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:53.190654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:53.191355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.191641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.191917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.192661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:53.192967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:53.194336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228b6b-aa77-43f9-b78d-23fc2801ee56 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:53.209883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 526/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:53.210566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.281615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805d108-bfdf-4c24-8789-2154393f28cd None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.281932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805d108-bfdf-4c24-8789-2154393f28cd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.282181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805d108-bfdf-4c24-8789-2154393f28cd None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.283717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 527/1056] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:53.288649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.288943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.289312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.306606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:53.307837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:53.309878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d028aa-a182-4664-aa2a-0bb082e1b5c8 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:53.342480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:53.343379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.343661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.343936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] PATH_INFO: `/v3/users/6bd5f6bf56d347158440b7a51b281f0a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.357615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5f6bf56d347158440b7a51b281f0a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:53.359054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:53.360812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 530/1057] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/users/6bd5f6bf56d347158440b7a51b281f0a => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:53.366309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.380208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 528/1058] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:53.403136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.469708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dc539-f035-4cf3-bf7b-caa0db36fe1e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:53.508203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755c432-121e-4632-b07e-c163d2e7bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:53.508874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755c432-121e-4632-b07e-c163d2e7bb89 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.509158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755c432-121e-4632-b07e-c163d2e7bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.509433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755c432-121e-4632-b07e-c163d2e7bb89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.513791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d21c-9d7d-4455-9297-6a5a2e4b0d51 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:53.551635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3859cd-c2aa-4e43-bd9b-45cc09c400f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:53.552545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3859cd-c2aa-4e43-bd9b-45cc09c400f3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.553043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3859cd-c2aa-4e43-bd9b-45cc09c400f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.553649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3859cd-c2aa-4e43-bd9b-45cc09c400f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.589175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755c432-121e-4632-b07e-c163d2e7bb89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:53.590721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755c432-121e-4632-b07e-c163d2e7bb89 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:53.626091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3859cd-c2aa-4e43-bd9b-45cc09c400f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:53.627860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3859cd-c2aa-4e43-bd9b-45cc09c400f3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:53.688975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 531/1059] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 16:09:53.690758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eae71-ce6a-4107-9d91-062e29ee5908 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.691050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eae71-ce6a-4107-9d91-062e29ee5908 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.691354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eae71-ce6a-4107-9d91-062e29ee5908 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.692949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 532/1060] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:53.694638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eae71-ce6a-4107-9d91-062e29ee5908 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.729392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 529/1061] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 16:09:53.730676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.730973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.731275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.747522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:53.748617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:53.832832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eae71-ce6a-4107-9d91-062e29ee5908 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:53.865466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 530/1062] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:53.866103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.872397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:53.872397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:53.872397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:53.872397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:53.872730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d41752f822f6426486ce5274a5f74344)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:53.873775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:53.875583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 533/1063] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/projects/d41752f822f6426486ce5274a5f74344 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:53.881691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:53.989102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c76cb-158e-4822-ac48-73886f8ce9fe None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.021049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.021838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.022121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.022396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.022515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd671b9f-c948-46bf-ab5f-9fb46d2756a7 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.033794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.035236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:54.052457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:54.053563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:54.054836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:54.054836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:54.054836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:54.054836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:54.054836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 531/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:54.056234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.058474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.059132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.059443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.059718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.060532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=d41752f822f6426486ce5274a5f74344, user.id=6bd5f6bf56d347158440b7a51b281f0a) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:54.060839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.062245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.067990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 534/1065] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:09:53 2022] GET /identity/v3/role_assignments?user.id=6bd5f6bf56d347158440b7a51b281f0a&scope.project.id=d41752f822f6426486ce5274a5f74344&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:54.068682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.162161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530ee1-87ff-440e-b980-4e9f84c63892 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.174546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0876d1-5cd6-4e43-86d6-c0177720f10c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.198359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.199396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.200050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.200334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.211159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.211960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.212244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.212519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.212784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:54.213246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:54.213549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.214985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:54.221305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:54.222322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:54.223195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 532/1066] 10.222.0.42 () {56 vars in 1120 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:54.229374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.239366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 535/1067] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:54.342118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5638-9c30-497b-a874-94d64b9cb13d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.377249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.377927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.378211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.378488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.379247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:54.379606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.381033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.391041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 533/1068] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:54.397662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.498504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab3db-9fce-4897-929e-8bdaf607c2e0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.533430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.534235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.534514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.534787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.546960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.548507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:54.566935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:54.568169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:54.570738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:54.570738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:54.570738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:54.570738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:54.570738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 536/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:54.576545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.671830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fff2ea-3b0e-40d9-8798-94faa9e6707e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.704514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.705166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.705451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.705728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.706482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:54.706790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.708190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.719919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 534/1070] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:54.725424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.821835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00006-4c58-4b56-9789-2f171dbb1444 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:54.854012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:54.854999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:54.855154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:54.855364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:54.863044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:54.864523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:54.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:54.880473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:54.881659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:54.887195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 537/1071] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:54.887403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:54.983467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c6ab0-7e81-4e90-87fa-745c3874373e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:55.015495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:55.016150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:55.016431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:55.016702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:55.017522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:55.017828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:55.019232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:55.035946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 535/1072] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:55.041901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:55.137165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cc41-d374-4923-ae4c-6d808a82d829 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:55.170108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:55.170892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:55.171167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:55.171461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:55.182548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:55.184049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:55.206347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:55.207487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:55.208386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:55.208386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:55.208386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:55.208386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:55.208386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 538/1073] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:55.213862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:55.310623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091acd-684a-4824-9982-c0e258adc59e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:55.344019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:55.344668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:55.344954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:55.345234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:55.345947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:55.346256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:55.347654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:55.358717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 536/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:55.364189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:55.461191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536356e2-990b-4be1-abc9-f4b475d24b54 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:55.496862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:55.497650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:55.497936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:55.498205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:55.505010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:55.506434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:55.522553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:55.523733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:55.524657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 539/1075] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:55.529573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:55.625166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe0c42-0ce5-4ef1-97b5-8129ad873896 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:55.657287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:55.657939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:55.658223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:55.658498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:55.659291 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:55.659624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:55.661023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0e97f-54b0-43df-94a8-dc290cc503a2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:55.673395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 537/1076] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:55.679697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:55.776051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f26bf-d435-46b2-bffe-2e2957499092 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:55.809495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ba5d-de27-49b4-be20-6bb8fab58a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:55.810385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ba5d-de27-49b4-be20-6bb8fab58a7c None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:55.810667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ba5d-de27-49b4-be20-6bb8fab58a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:55.810940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ba5d-de27-49b4-be20-6bb8fab58a7c None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/7bc226da24944f578dd20785b5bcece6/roles/b8adf967e2fc4fd3b05bba156f58e5c7` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:55.813173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ba5d-de27-49b4-be20-6bb8fab58a7c None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=7bc226da24944f578dd20785b5bcece6, role_id=b8adf967e2fc4fd3b05bba156f58e5c7)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:55.814597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ba5d-de27-49b4-be20-6bb8fab58a7c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:55.935217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 540/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:55 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/7bc226da24944f578dd20785b5bcece6/roles/b8adf967e2fc4fd3b05bba156f58e5c7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:56.316555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6b630-407c-484a-8f8a-4603deae4b14 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:56.317092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6b630-407c-484a-8f8a-4603deae4b14 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:56.317092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6b630-407c-484a-8f8a-4603deae4b14 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:56.318451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 538/1078] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:56.323698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:56.323991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:56.324267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:56.340914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:56.342064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:56.404511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 541/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:56.427376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6b630-407c-484a-8f8a-4603deae4b14 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:56.526450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6b630-407c-484a-8f8a-4603deae4b14 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:56.558164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:56.558944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:56.559222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:56.559522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:56.569180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:56.577430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:56.578509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:56.579739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 539/1080] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:56.584750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:56.679642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d765da5-4788-49f5-8261-46eb7b8f1384 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:56.712265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:56.712918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:56.713195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:56.713463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:56.714194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:56.714497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:56.717445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:56.724086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 542/1081] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:56.730662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:56.826687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e56cd9-07c9-463f-a0dd-f49cfbc3f9c0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:56.858590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:56.859476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:56.859763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:56.860035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] PATH_INFO: `/v3/users/6bd5f6bf56d347158440b7a51b281f0a` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:56.861190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5f6bf56d347158440b7a51b281f0a)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:56.862603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:56.864403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 540/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:09:56 2022] GET /identity/v3/users/6bd5f6bf56d347158440b7a51b281f0a => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:56.870403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:56.965412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23836d-d261-455a-af77-192c95689cfb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:56.997930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7a496-8814-4f5d-9e55-49102e0b3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:56.998788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a496-8814-4f5d-9e55-49102e0b3859 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:56.999072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a496-8814-4f5d-9e55-49102e0b3859 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:56.999383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7a496-8814-4f5d-9e55-49102e0b3859 None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:57.000570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a496-8814-4f5d-9e55-49102e0b3859 None admin] RBAC: Authorizing `identity:get_project(project_id=d41752f822f6426486ce5274a5f74344)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:57.001996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7a496-8814-4f5d-9e55-49102e0b3859 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:57.003735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 543/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:09:56 2022] GET /identity/v3/projects/d41752f822f6426486ce5274a5f74344 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:57.010154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:57.105915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d433-954f-49d1-9456-998fef414c0d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:57.138129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccee73-4b59-45ea-8dcb-ffd2665f745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:57.139281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccee73-4b59-45ea-8dcb-ffd2665f745d None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:57.139590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccee73-4b59-45ea-8dcb-ffd2665f745d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:57.139844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccee73-4b59-45ea-8dcb-ffd2665f745d None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344/users/6bd5f6bf56d347158440b7a51b281f0a/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:57.141751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccee73-4b59-45ea-8dcb-ffd2665f745d None admin] RBAC: Authorizing `identity:create_grant(project_id=d41752f822f6426486ce5274a5f74344, user_id=6bd5f6bf56d347158440b7a51b281f0a, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:57.143164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccee73-4b59-45ea-8dcb-ffd2665f745d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:57.220746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 541/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:09:57 2022] PUT /identity/v3/projects/d41752f822f6426486ce5274a5f74344/users/6bd5f6bf56d347158440b7a51b281f0a/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:09:58.166392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b86372-61f3-4f39-a6f6-7d0fdb1909a1 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:58.166997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b86372-61f3-4f39-a6f6-7d0fdb1909a1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:58.166997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b86372-61f3-4f39-a6f6-7d0fdb1909a1 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:58.168518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 544/1085] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:09:58.173300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:58.173717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:58.173848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:58.190748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:58.191937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:58.254945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 542/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:09:58.277808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b86372-61f3-4f39-a6f6-7d0fdb1909a1 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:58.377660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b86372-61f3-4f39-a6f6-7d0fdb1909a1 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:58.410056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:58.410858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:58.411143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:58.411452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:58.423017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:58.431358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:58.432532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:58.433463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 545/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Tue May 3 16:09:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:58.438464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:58.536516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb86d7-6ba5-4545-8789-e00aa8371413 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:58.568749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:58.569588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:58.569874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:58.570145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:58.570889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:58.571191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:58.572584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:58.580302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 543/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:09:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:58.586592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:58.682211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c54c6-3ca2-41d6-97f7-5713f9dec4d2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:58.715450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:58.716234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:58.716511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:58.716777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:58.726543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:58.727994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:58.744748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:58.745855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:58.751863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:58.751863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:58.751863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:58.751863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:58.751863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 546/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:58.752660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:58.847757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63c4f2-eed9-45c8-b36c-412e0981db81 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:58.879838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:58.880488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:58.880768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:58.881052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:58.881782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:58.882184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:58.883564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:58.895058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 544/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:58.900823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:58.995279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8cf82-e5bb-4c98-9db8-ef131e710c47 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.027601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.028388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.028670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.028944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.036292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.037709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:09:59.051167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:59.052334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:59.054149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 547/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Tue May 3 16:09:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:59.058527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.152948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497b181-f6e9-4259-be4a-96de74f8f6d0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.185057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.185699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.185982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.186255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.187077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:59.187417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.188827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fccd9-953a-4008-96e7-c42a2eb661b4 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.206005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 545/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:09:59.211529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.311465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03491ce6-8efe-4295-848f-496d39fc0d7b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.344159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.344806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.345087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.345361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.408777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.410221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.466703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6333-9913-4fe8-a614-76c7a75b45d5 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.466993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6333-9913-4fe8-a614-76c7a75b45d5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.467289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6333-9913-4fe8-a614-76c7a75b45d5 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.468662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 546/1093] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:09:59.473385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.473671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.473950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.490446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:09:59.492330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:09:59.505600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 548/1094] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:09:59.512233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.558950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 547/1095] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:09:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:09:59.581844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.606844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90d02a-b34e-4b02-8bc4-efaac52f2813 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.640737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.641523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.641803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.642077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.652119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.653540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:09:59.672314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:59.673321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:59.674513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:09:59.674513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:09:59.674513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:09:59.674513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:59.674513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 549/1096] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:09:59.677055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438a4e5-af95-409d-a8fb-c3b67fd5fc11 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.679840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.711271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.712078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.712359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.712632 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.722195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:09:59.729626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:59.730561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:09:59.731469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 548/1097] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:59.736790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.775766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109e042-7b2c-4c81-a43e-3f0f63db7511 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.808403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.809075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.809360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.809635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.810344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:59.810647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.812031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.823517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 550/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:59.828948 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.832862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82838dd6-7e4a-4c79-8b06-f9c3e4ad6129 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.864224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.864876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.865156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.865435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.866719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:09:59.867081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.868431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.876152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 549/1099] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:09:59.881685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.924541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebe9c0-a2ae-4b0d-984e-d388b43d587e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:09:59.956689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:09:59.957476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:09:59.957760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:09:59.958038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:09:59.965548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:09:59.966969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:09:59.982001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:09:59.983098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:09:59.984286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 551/1100] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:09:59.988909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:09:59.993557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462453-be74-4dca-919e-495ed68f0f84 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:00.025533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:00.026382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:00.026660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:00.026930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] PATH_INFO: `/v3/users/6bd5f6bf56d347158440b7a51b281f0a` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:00.028135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] RBAC: Authorizing `identity:get_user(user_id=6bd5f6bf56d347158440b7a51b281f0a)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:00.029556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:00.031161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 550/1101] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/users/6bd5f6bf56d347158440b7a51b281f0a => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:00.036804 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:00.085445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75d1df-9d56-40d5-9f17-7c7345cbfa5d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:00.119082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:00.119751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:00.120033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:00.120305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:00.121071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:00.121375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:00.122785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:00.130350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ba2e-32b4-43e0-934d-145586c288be None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:00.134516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 552/1102] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:09:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:10:00.140632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:00.163947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:00.164589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:00.164876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:00.165153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:00.229138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:00.230596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:00.236405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307b82-803e-4554-9c04-40d138097c66 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:00.269407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:00.270046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:00.270332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:00.270605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:00.271451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] RBAC: Adding query filter params (role.id=b8adf967e2fc4fd3b05bba156f58e5c7, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=7bc226da24944f578dd20785b5bcece6) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:00.271762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:00.274300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:00.279935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 553/1103] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:00 2022] GET /identity/v3/role_assignments?user.id=7bc226da24944f578dd20785b5bcece6&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=b8adf967e2fc4fd3b05bba156f58e5c7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:10:00.329941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 551/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 16:10:00.336924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:00.439884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14baa9-c28e-44f3-99ce-394672c8df6c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:00.476008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0ab74-9e3b-40bb-8ec3-f6f87d204f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:00.476929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ab74-9e3b-40bb-8ec3-f6f87d204f17 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:00.477206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ab74-9e3b-40bb-8ec3-f6f87d204f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:00.477478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0ab74-9e3b-40bb-8ec3-f6f87d204f17 None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:00.478700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0ab74-9e3b-40bb-8ec3-f6f87d204f17 None admin] RBAC: Authorizing `identity:get_project(project_id=d41752f822f6426486ce5274a5f74344)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:00.480173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0ab74-9e3b-40bb-8ec3-f6f87d204f17 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:00.481881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 554/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:00 2022] GET /identity/v3/projects/d41752f822f6426486ce5274a5f74344 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:00.488030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:00.589160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40d679-d4fd-4c6d-a3eb-362563fac143 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:00.623709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:00.624364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:00.624644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:00.624921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:00.625744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=d41752f822f6426486ce5274a5f74344, user.id=6bd5f6bf56d347158440b7a51b281f0a) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:00.626060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:00.627525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28ca3-35d3-499d-8289-f3524b182a46 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:00.634210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 552/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:00 2022] GET /identity/v3/role_assignments?user.id=6bd5f6bf56d347158440b7a51b281f0a&scope.project.id=d41752f822f6426486ce5274a5f74344&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:02.882684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb005d30-ab50-4a69-b674-b9bea1559266 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:02.883229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb005d30-ab50-4a69-b674-b9bea1559266 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:02.883229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb005d30-ab50-4a69-b674-b9bea1559266 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:02.884741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 555/1107] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:02.890148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99873960-c551-4fda-8a20-877f8af40116 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:02.890558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99873960-c551-4fda-8a20-877f8af40116 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:02.890713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99873960-c551-4fda-8a20-877f8af40116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:02.906985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-99873960-c551-4fda-8a20-877f8af40116 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:02.908185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-99873960-c551-4fda-8a20-877f8af40116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:02.971356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 553/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:02.996033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb005d30-ab50-4a69-b674-b9bea1559266 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:03.092541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb005d30-ab50-4a69-b674-b9bea1559266 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:03.124203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80279336-bb17-4899-860e-13c6ee15cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:03.124973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80279336-bb17-4899-860e-13c6ee15cb92 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:03.125262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80279336-bb17-4899-860e-13c6ee15cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:03.125538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80279336-bb17-4899-860e-13c6ee15cb92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:03.126697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80279336-bb17-4899-860e-13c6ee15cb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:03.128150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80279336-bb17-4899-860e-13c6ee15cb92 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:03.129746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 556/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:03.136123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99873960-c551-4fda-8a20-877f8af40116 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:03.229711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99873960-c551-4fda-8a20-877f8af40116 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:03.261265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17c1fb-78ca-4ff4-9b86-1a606026326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:03.261912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c1fb-78ca-4ff4-9b86-1a606026326e None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:03.262193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c1fb-78ca-4ff4-9b86-1a606026326e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:03.262464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c1fb-78ca-4ff4-9b86-1a606026326e None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:03.263150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17c1fb-78ca-4ff4-9b86-1a606026326e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:03.264834 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17c1fb-78ca-4ff4-9b86-1a606026326e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:03.357946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 554/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:10:03 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:10:05.637478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52907782-80fe-43b0-9436-48ca7f52da8c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:05.637994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52907782-80fe-43b0-9436-48ca7f52da8c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:05.638097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52907782-80fe-43b0-9436-48ca7f52da8c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:05.639701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 557/1111] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:05.644882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:05.645270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:05.645455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:05.662128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:05.663922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:05.727588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 555/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:05.752250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52907782-80fe-43b0-9436-48ca7f52da8c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:05.849045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52907782-80fe-43b0-9436-48ca7f52da8c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:05.880639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:05.881546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:05.881831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:05.882109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] PATH_INFO: `/v3/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:05.883615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] RBAC: Authorizing `identity:get_role(role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:05.884969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:05.886316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 558/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:05 2022] GET /identity/v3/roles/aa3a7655caa4456091096e448052a63b => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:05.892229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:05.985450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a2791-6c23-4a82-8a4f-341158ad3a95 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:06.016993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:06.017849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:06.018130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:06.018403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] PATH_INFO: `/v3/users/abd59e906ead4500afd1cbcac2f82ea6` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:06.031601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=abd59e906ead4500afd1cbcac2f82ea6)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:06.033026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:06.034643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 556/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:05 2022] GET /identity/v3/users/abd59e906ead4500afd1cbcac2f82ea6 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:06.041435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:06.135051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebcec-dc16-4574-878f-f89051c00efc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:06.167588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:06.168220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:06.168502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:06.168776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:06.231764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:06.233187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:06.324963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 559/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 16:10:06.330812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:06.423394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692fa69-07a9-4f04-88d4-a3e17b057dc1 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:06.454888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4810b0-f77c-41c0-bcf2-af8d8296ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:06.455748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4810b0-f77c-41c0-bcf2-af8d8296ea36 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:06.456028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4810b0-f77c-41c0-bcf2-af8d8296ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:06.456303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4810b0-f77c-41c0-bcf2-af8d8296ea36 None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:06.457458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4810b0-f77c-41c0-bcf2-af8d8296ea36 None admin] RBAC: Authorizing `identity:get_project(project_id=d41752f822f6426486ce5274a5f74344)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:06.458869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4810b0-f77c-41c0-bcf2-af8d8296ea36 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:06.461126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 557/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:06 2022] GET /identity/v3/projects/d41752f822f6426486ce5274a5f74344 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:06.467187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:06.561922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0277-aff4-44bc-9ad0-fc51b80f4bff None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:06.594657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:06.595313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:06.595591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:06.595862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:06.596668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] RBAC: Adding query filter params (role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=d41752f822f6426486ce5274a5f74344, user.id=abd59e906ead4500afd1cbcac2f82ea6) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:06.596969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:06.598366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4db6db-9e2d-4401-b523-49d66041ef99 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:06.603661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 560/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:06 2022] GET /identity/v3/role_assignments?user.id=abd59e906ead4500afd1cbcac2f82ea6&scope.project.id=d41752f822f6426486ce5274a5f74344&role.id=aa3a7655caa4456091096e448052a63b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:08.814150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836edce-5fff-4a44-9cc7-4ffe50be6e10 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:08.814674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836edce-5fff-4a44-9cc7-4ffe50be6e10 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:08.814762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836edce-5fff-4a44-9cc7-4ffe50be6e10 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:08.816102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 558/1118] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:08.822002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:08.822458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:08.822554 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:08.838645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:08.839827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:08.905322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 561/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:08.927180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836edce-5fff-4a44-9cc7-4ffe50be6e10 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:09.022684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836edce-5fff-4a44-9cc7-4ffe50be6e10 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:09.054205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:09.055027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:09.055331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:09.055607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] PATH_INFO: `/v3/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:09.057043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] RBAC: Authorizing `identity:get_role(role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:09.058393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:09.059768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 559/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:08 2022] GET /identity/v3/roles/aa3a7655caa4456091096e448052a63b => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:09.065503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:09.159440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd53cf-7808-4486-b6aa-3b455869b07b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:09.192689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:09.193662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:09.194119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:09.194458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] PATH_INFO: `/v3/users/abd59e906ead4500afd1cbcac2f82ea6` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:09.195666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] RBAC: Authorizing `identity:get_user(user_id=abd59e906ead4500afd1cbcac2f82ea6)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:09.197093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:09.198700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 562/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:09 2022] GET /identity/v3/users/abd59e906ead4500afd1cbcac2f82ea6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:09.204917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:09.301084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501114c-3f81-4867-995e-222d86ab7304 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:09.333320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baaf11-168d-4f2c-84ca-f975dfeef4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:09.334095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baaf11-168d-4f2c-84ca-f975dfeef4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:09.334500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baaf11-168d-4f2c-84ca-f975dfeef4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:09.334921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baaf11-168d-4f2c-84ca-f975dfeef4d8 None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:09.336195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baaf11-168d-4f2c-84ca-f975dfeef4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d41752f822f6426486ce5274a5f74344)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:09.337644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baaf11-168d-4f2c-84ca-f975dfeef4d8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:09.339332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 560/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:09 2022] GET /identity/v3/projects/d41752f822f6426486ce5274a5f74344 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:09.345649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:09.441117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808f38c-9e9d-429d-a3c5-7ac94d5bf681 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:09.472632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afcb51-bbfb-4582-aa09-e7a25a69760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:09.473501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcb51-bbfb-4582-aa09-e7a25a69760c None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:09.473785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcb51-bbfb-4582-aa09-e7a25a69760c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:09.474060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcb51-bbfb-4582-aa09-e7a25a69760c None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344/users/abd59e906ead4500afd1cbcac2f82ea6/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:09.476978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afcb51-bbfb-4582-aa09-e7a25a69760c None admin] RBAC: Authorizing `identity:create_grant(project_id=d41752f822f6426486ce5274a5f74344, user_id=abd59e906ead4500afd1cbcac2f82ea6, role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:09.478397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afcb51-bbfb-4582-aa09-e7a25a69760c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:09.556755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 563/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:10:09 2022] PUT /identity/v3/projects/d41752f822f6426486ce5274a5f74344/users/abd59e906ead4500afd1cbcac2f82ea6/roles/aa3a7655caa4456091096e448052a63b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:10:11.773105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319e69-26d9-43b9-88b0-8143bb3913bf None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:11.773637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319e69-26d9-43b9-88b0-8143bb3913bf None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:11.773637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319e69-26d9-43b9-88b0-8143bb3913bf None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:11.774922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 561/1124] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:11.780102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:11.780548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:11.780644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:11.796776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:11.797950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:11.860715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 564/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:11.884889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319e69-26d9-43b9-88b0-8143bb3913bf None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:11.979644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319e69-26d9-43b9-88b0-8143bb3913bf None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:12.012201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:12.013320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:12.013604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:12.013877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] PATH_INFO: `/v3/roles/aa3a7655caa4456091096e448052a63b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:12.015351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] RBAC: Authorizing `identity:get_role(role_id=aa3a7655caa4456091096e448052a63b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:12.016715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:12.018064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 562/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:11 2022] GET /identity/v3/roles/aa3a7655caa4456091096e448052a63b => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:12.024112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:12.118333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225af5-7e38-404d-a8d1-382a851f1846 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:12.150951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:12.151903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:12.152187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:12.152454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] PATH_INFO: `/v3/users/abd59e906ead4500afd1cbcac2f82ea6` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:12.153611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] RBAC: Authorizing `identity:get_user(user_id=abd59e906ead4500afd1cbcac2f82ea6)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:12.155013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:12.156806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 565/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:12 2022] GET /identity/v3/users/abd59e906ead4500afd1cbcac2f82ea6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:12.162999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:12.255157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c233d8-1eb9-4424-8ca5-555ec979da59 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:12.291577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:12.292203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:12.292480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:12.292751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:12.355111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:12.356541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:12.448843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 563/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:10:12.454653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:12.548387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064655-351c-445c-a2fd-658fdfa9ff78 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:12.581422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a40c02-dd25-467a-8a4e-fdb2f7153a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:12.582256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40c02-dd25-467a-8a4e-fdb2f7153a17 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:12.582533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40c02-dd25-467a-8a4e-fdb2f7153a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:12.582803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40c02-dd25-467a-8a4e-fdb2f7153a17 None admin] PATH_INFO: `/v3/projects/d41752f822f6426486ce5274a5f74344` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:12.584463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a40c02-dd25-467a-8a4e-fdb2f7153a17 None admin] RBAC: Authorizing `identity:get_project(project_id=d41752f822f6426486ce5274a5f74344)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:12.586066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a40c02-dd25-467a-8a4e-fdb2f7153a17 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:12.587758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 566/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:12 2022] GET /identity/v3/projects/d41752f822f6426486ce5274a5f74344 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:12.593760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:12.686573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930304a4-4ae1-439a-97a5-c320dcbd6f54 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:12.718302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:12.718927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:12.719205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:12.719501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:12.720306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] RBAC: Adding query filter params (role.id=aa3a7655caa4456091096e448052a63b, scope.project.id=d41752f822f6426486ce5274a5f74344, user.id=abd59e906ead4500afd1cbcac2f82ea6) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:12.720612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:12.722011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe113e-b814-498d-83d6-aeda98dd2296 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:12.728335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 564/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:12 2022] GET /identity/v3/role_assignments?user.id=abd59e906ead4500afd1cbcac2f82ea6&scope.project.id=d41752f822f6426486ce5274a5f74344&role.id=aa3a7655caa4456091096e448052a63b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:14.955174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e0273-87dc-4ab5-8194-94fbc221f4bf None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:14.955820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e0273-87dc-4ab5-8194-94fbc221f4bf None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:14.955820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e0273-87dc-4ab5-8194-94fbc221f4bf None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:14.957181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 567/1131] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:14.962396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:14.962798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:14.962958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:14.979031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:14.980226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:15.043498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 565/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:15.066798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e0273-87dc-4ab5-8194-94fbc221f4bf None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:15.163525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e0273-87dc-4ab5-8194-94fbc221f4bf None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:15.195222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad59d1-a6f2-4c39-afbb-bc6b9fbe8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:15.196006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad59d1-a6f2-4c39-afbb-bc6b9fbe8ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:15.196283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad59d1-a6f2-4c39-afbb-bc6b9fbe8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:15.196552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad59d1-a6f2-4c39-afbb-bc6b9fbe8ba1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:15.197689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad59d1-a6f2-4c39-afbb-bc6b9fbe8ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:15.199093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad59d1-a6f2-4c39-afbb-bc6b9fbe8ba1 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:15.200698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 568/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:15.206526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:15.301059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e2565-aa8d-4b40-ba95-5ef3687b42ef None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:15.332759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc825ba8-8b13-4979-b4b1-2da461727694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:15.333400 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825ba8-8b13-4979-b4b1-2da461727694 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:15.333678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825ba8-8b13-4979-b4b1-2da461727694 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:15.333976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825ba8-8b13-4979-b4b1-2da461727694 None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:15.334665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc825ba8-8b13-4979-b4b1-2da461727694 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:15.336095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc825ba8-8b13-4979-b4b1-2da461727694 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:15.455274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 566/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:10:15 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:10:17.788397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f75f8-c45e-413c-8ed9-05b0ff7be10c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:17.788940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f75f8-c45e-413c-8ed9-05b0ff7be10c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:17.788940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f75f8-c45e-413c-8ed9-05b0ff7be10c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:17.790357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 569/1135] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:17.795628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:17.796039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:17.796192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:17.813467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:17.814668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:17.877226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 567/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:17.903598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f75f8-c45e-413c-8ed9-05b0ff7be10c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:17.998665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f75f8-c45e-413c-8ed9-05b0ff7be10c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:18.031449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4992-2832-49a2-8873-8b0cc213b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:18.032215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4992-2832-49a2-8873-8b0cc213b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:18.032491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4992-2832-49a2-8873-8b0cc213b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:18.032758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4992-2832-49a2-8873-8b0cc213b5a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:18.033902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4992-2832-49a2-8873-8b0cc213b5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:18.035337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4992-2832-49a2-8873-8b0cc213b5a6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:18.036988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 570/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:18.042649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:18.137048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43603-aec2-4e7f-bed1-930d198dbc1e None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:18.169165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa4af-1e86-4021-8d91-72c24d15e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:18.169810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa4af-1e86-4021-8d91-72c24d15e9b2 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:18.170088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa4af-1e86-4021-8d91-72c24d15e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:18.170359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa4af-1e86-4021-8d91-72c24d15e9b2 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:18.171056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa4af-1e86-4021-8d91-72c24d15e9b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:18.172490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa4af-1e86-4021-8d91-72c24d15e9b2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:18.265965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 568/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:10:18 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:10:20.564766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd348e14-ad07-4ce0-a56f-83348cee23b2 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:20.565298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd348e14-ad07-4ce0-a56f-83348cee23b2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:20.565298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd348e14-ad07-4ce0-a56f-83348cee23b2 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:20.566717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 571/1139] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:20.572524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:20.572939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:20.573070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:20.590201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:20.591399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:20.654924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 569/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:20.678291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd348e14-ad07-4ce0-a56f-83348cee23b2 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:20.774289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd348e14-ad07-4ce0-a56f-83348cee23b2 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:20.805834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:20.806590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:20.806868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:20.807137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:20.816644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:10:20.824874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:20.826033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:10:20.827102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 572/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:20.831856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:20.925212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc6b42-bb51-4212-bb37-e13d8062383f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:20.959231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:20.959910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:20.960190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:20.960462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:20.961194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:20.961495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:20.962910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:20.970607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 570/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:20.977083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:21.073177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c63a9-f05c-4049-b8ab-2b14e5eb06bc None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:21.103952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:21.104795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:21.105074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:21.105343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] PATH_INFO: `/v3/users/5aeee47392c846c6b652bf7786e9fd30` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:21.118248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] RBAC: Authorizing `identity:get_user(user_id=5aeee47392c846c6b652bf7786e9fd30)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:21.119696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:21.121302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 573/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:20 2022] GET /identity/v3/users/5aeee47392c846c6b652bf7786e9fd30 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:21.126936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:21.222215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3401ae-c8d4-4066-923c-3728163723da None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:21.254352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:21.254983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:21.255290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:21.255593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:21.318360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:21.319810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:21.410984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 571/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:10:21.417181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:21.509748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c2361-3bf3-4488-8363-ef81bae289c4 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:21.541950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ab2c-066f-4ce5-a7c9-3a281228874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:21.542794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ab2c-066f-4ce5-a7c9-3a281228874b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:21.543072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ab2c-066f-4ce5-a7c9-3a281228874b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:21.543376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ab2c-066f-4ce5-a7c9-3a281228874b None admin] PATH_INFO: `/v3/projects/8db40853c4e4427683fc91da85861a4f` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:21.544526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ab2c-066f-4ce5-a7c9-3a281228874b None admin] RBAC: Authorizing `identity:get_project(project_id=8db40853c4e4427683fc91da85861a4f)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:21.545937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ab2c-066f-4ce5-a7c9-3a281228874b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:21.547633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 574/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:21 2022] GET /identity/v3/projects/8db40853c4e4427683fc91da85861a4f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:21.554324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:21.648595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82956331-08f3-4319-850a-cebbc47a94d9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:21.680813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:21.681391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:21.681675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:21.681950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:21.682759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=8db40853c4e4427683fc91da85861a4f, user.id=5aeee47392c846c6b652bf7786e9fd30) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:21.683070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:21.684689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ba280-ba42-4eb2-9726-fe989d29fc6d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:21.691284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 572/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:21 2022] GET /identity/v3/role_assignments?user.id=5aeee47392c846c6b652bf7786e9fd30&scope.project.id=8db40853c4e4427683fc91da85861a4f&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:10:23.907329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854e952-e20a-4733-9773-697441a8521d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:23.907898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854e952-e20a-4733-9773-697441a8521d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:23.907898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854e952-e20a-4733-9773-697441a8521d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:23.909252 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 575/1147] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:23.915121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:23.915528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:23.915722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:23.932131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:23.933313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:23.997619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 573/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:24.020420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854e952-e20a-4733-9773-697441a8521d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:24.118086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854e952-e20a-4733-9773-697441a8521d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:24.150525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:24.151321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:24.151606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:24.151882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:24.162142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:10:24.169657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:24.170755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:10:24.171771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 576/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:24.177154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:24.272912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811a5b-f25f-4e11-8ec1-dc295399d8a6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:24.304374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:24.305014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:24.305292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:24.305561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:24.306283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:24.306582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:24.307954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:24.315544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 574/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:24.322023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:24.416616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5798a9-dbfc-43e0-a06c-573cfa2757ae None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:24.448076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:24.448929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:24.449211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:24.449483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] PATH_INFO: `/v3/users/5aeee47392c846c6b652bf7786e9fd30` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:24.450652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] RBAC: Authorizing `identity:get_user(user_id=5aeee47392c846c6b652bf7786e9fd30)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:24.452092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:24.453885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 577/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:24 2022] GET /identity/v3/users/5aeee47392c846c6b652bf7786e9fd30 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:24.460176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:24.556758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a2d90-8558-4c63-8b19-e0ef8a25c71e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:24.589184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287300-91a2-4f67-98e6-c1496d8b65fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:24.590047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287300-91a2-4f67-98e6-c1496d8b65fa None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:24.590329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287300-91a2-4f67-98e6-c1496d8b65fa None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:24.590603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287300-91a2-4f67-98e6-c1496d8b65fa None admin] PATH_INFO: `/v3/projects/8db40853c4e4427683fc91da85861a4f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:24.591801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287300-91a2-4f67-98e6-c1496d8b65fa None admin] RBAC: Authorizing `identity:get_project(project_id=8db40853c4e4427683fc91da85861a4f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:24.593260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287300-91a2-4f67-98e6-c1496d8b65fa None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:24.594966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 575/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:24 2022] GET /identity/v3/projects/8db40853c4e4427683fc91da85861a4f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:10:24.601245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:24.697127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36882c-d02c-4334-a787-6c2f9ba15058 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:24.728564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316feb56-7c8f-4a33-a53b-eeeb2cce3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:24.729425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316feb56-7c8f-4a33-a53b-eeeb2cce3328 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:24.729700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316feb56-7c8f-4a33-a53b-eeeb2cce3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:24.729969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316feb56-7c8f-4a33-a53b-eeeb2cce3328 None admin] PATH_INFO: `/v3/projects/8db40853c4e4427683fc91da85861a4f/users/5aeee47392c846c6b652bf7786e9fd30/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:24.731896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316feb56-7c8f-4a33-a53b-eeeb2cce3328 None admin] RBAC: Authorizing `identity:create_grant(project_id=8db40853c4e4427683fc91da85861a4f, user_id=5aeee47392c846c6b652bf7786e9fd30, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:24.733304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316feb56-7c8f-4a33-a53b-eeeb2cce3328 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:24.863954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 578/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:10:24 2022] PUT /identity/v3/projects/8db40853c4e4427683fc91da85861a4f/users/5aeee47392c846c6b652bf7786e9fd30/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:10:27.085733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103389-98c0-4da1-bc00-1b9e6a81980c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:27.086297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103389-98c0-4da1-bc00-1b9e6a81980c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:27.086297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103389-98c0-4da1-bc00-1b9e6a81980c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:27.087671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 576/1154] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:27.092892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:27.093317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:27.093448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:27.110438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:27.111648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:27.175275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 579/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:27.198196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58103389-98c0-4da1-bc00-1b9e6a81980c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:27.294929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58103389-98c0-4da1-bc00-1b9e6a81980c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:27.326368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:27.327135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:27.327438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:27.327712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:27.337777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:10:27.345104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:27.346177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:10:27.347386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 577/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:10:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:27.352600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:27.446686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66b36-4569-4f13-ac19-459c1387275c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:27.479207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:27.479877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:27.480156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:27.480454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:27.481183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:27.481483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:27.482822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:27.490713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 580/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:10:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:27.496375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:27.592484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5760c-525b-430b-88d2-d4558f07f149 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:27.624312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:27.625164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:27.625443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:27.625714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] PATH_INFO: `/v3/users/5aeee47392c846c6b652bf7786e9fd30` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:27.626876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] RBAC: Authorizing `identity:get_user(user_id=5aeee47392c846c6b652bf7786e9fd30)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:27.628337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:27.629939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 578/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:27 2022] GET /identity/v3/users/5aeee47392c846c6b652bf7786e9fd30 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:27.636246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:27.728545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf1b7-94b3-4c3f-b7ae-7829318b3e5e None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:27.760357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:27.760976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:27.761257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:27.761528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:27.824592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:27.826028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:27.917511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 581/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:10:27.923226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:28.018524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d70c4-0b19-4d1b-b7d2-c9b18fb6d869 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:28.050414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8283a79-4343-400c-89f0-f30c2cadefdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:28.051277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8283a79-4343-400c-89f0-f30c2cadefdd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:28.051564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8283a79-4343-400c-89f0-f30c2cadefdd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:28.052488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8283a79-4343-400c-89f0-f30c2cadefdd None admin] PATH_INFO: `/v3/projects/8db40853c4e4427683fc91da85861a4f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:28.054748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8283a79-4343-400c-89f0-f30c2cadefdd None admin] RBAC: Authorizing `identity:get_project(project_id=8db40853c4e4427683fc91da85861a4f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:28.056200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8283a79-4343-400c-89f0-f30c2cadefdd None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:28.057890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 579/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:27 2022] GET /identity/v3/projects/8db40853c4e4427683fc91da85861a4f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:28.064189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:28.156569 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd1601-fe3a-4d06-8026-d19fbab933e2 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:28.189694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:28.190285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:28.190567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:28.190843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:28.191723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=8db40853c4e4427683fc91da85861a4f, user.id=5aeee47392c846c6b652bf7786e9fd30) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:28.192052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:28.193714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efab20-6aab-41de-976d-5d70b5b50f1c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:28.199660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 582/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:28 2022] GET /identity/v3/role_assignments?user.id=5aeee47392c846c6b652bf7786e9fd30&scope.project.id=8db40853c4e4427683fc91da85861a4f&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:30.426506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64147-ad44-47ec-84d7-e65d5b882058 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:30.427096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64147-ad44-47ec-84d7-e65d5b882058 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:30.427096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a64147-ad44-47ec-84d7-e65d5b882058 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:30.428477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 580/1162] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:30.433486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:30.433888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:30.434036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:30.450617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:30.451800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:30.515649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 583/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:30.538496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64147-ad44-47ec-84d7-e65d5b882058 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:30.639973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a64147-ad44-47ec-84d7-e65d5b882058 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:30.671320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:30.671951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:30.672235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:30.672514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:30.737239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:30.738596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:30.832344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 581/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:10:30.838268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:30.932197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145e94b-97a9-440c-96d5-3582ceccbae5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:30.963818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:30.964600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:30.964881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:30.965154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:30.971543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:30.972957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d8f0a18e-e5af-449b-910f-f4ab0ce1ebd9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:30.987040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:30.988225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:10:30.989463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 584/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:10:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:30.994725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:31.090807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a174ec9-ca7e-460d-9d27-87c8e14439e8 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:31.124321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:31.124973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:31.125257 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:31.125532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:31.126261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:31.126569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:31.128044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c73c81-b2e9-468a-b09a-26a55a0f4dd7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:31.135411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 582/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Tue May 3 16:10:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:33.376727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abbde6-e29a-48d9-baa1-5c2a38c8d58e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:33.377298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abbde6-e29a-48d9-baa1-5c2a38c8d58e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:33.377298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abbde6-e29a-48d9-baa1-5c2a38c8d58e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:33.378684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 585/1167] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:33.383940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d89d-3e3e-409b-ae22-c146e41ae2ef None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:33.384332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d89d-3e3e-409b-ae22-c146e41ae2ef None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:33.384504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d89d-3e3e-409b-ae22-c146e41ae2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:33.401044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e5c9d89d-3e3e-409b-ae22-c146e41ae2ef None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:33.402217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e5c9d89d-3e3e-409b-ae22-c146e41ae2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:33.466153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 583/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:33.489953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abbde6-e29a-48d9-baa1-5c2a38c8d58e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:33.587811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abbde6-e29a-48d9-baa1-5c2a38c8d58e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:33.620000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fec680-dbb3-4513-bb87-f952943a90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:33.620642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec680-dbb3-4513-bb87-f952943a90c8 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:33.620925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec680-dbb3-4513-bb87-f952943a90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:33.621202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec680-dbb3-4513-bb87-f952943a90c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:33.621942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fec680-dbb3-4513-bb87-f952943a90c8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:33.623524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fec680-dbb3-4513-bb87-f952943a90c8 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:33.745968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 586/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Tue May 3 16:10:33 2022] POST /identity/v3/domains => generated 267 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:10:35.970021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b453d8-cf4f-4b68-9d0f-a950bab4d935 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:35.970589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b453d8-cf4f-4b68-9d0f-a950bab4d935 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:35.970589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b453d8-cf4f-4b68-9d0f-a950bab4d935 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:35.972200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 584/1170] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:35.977409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:35.977859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:35.977984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:35.995018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:35.996234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:36.060292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 587/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 16:10:36.084195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b453d8-cf4f-4b68-9d0f-a950bab4d935 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:36.180847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b453d8-cf4f-4b68-9d0f-a950bab4d935 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:36.212111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a502cb-00bf-46a8-9d6a-ed28e8c270ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:36.212944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a502cb-00bf-46a8-9d6a-ed28e8c270ba None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:36.213223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a502cb-00bf-46a8-9d6a-ed28e8c270ba None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:36.213493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a502cb-00bf-46a8-9d6a-ed28e8c270ba None admin] PATH_INFO: `/v3/domains/bd3925c15d7942e8934f4ce83e1fb849` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:36.224085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a502cb-00bf-46a8-9d6a-ed28e8c270ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd3925c15d7942e8934f4ce83e1fb849)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:36.225461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a502cb-00bf-46a8-9d6a-ed28e8c270ba None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:36.227062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 585/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Tue May 3 16:10:36 2022] GET /identity/v3/domains/bd3925c15d7942e8934f4ce83e1fb849 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:36.232910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:36.326694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ba037-4a87-4ddf-bac5-feefa533ac1e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:36.358650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5d5df-3280-4909-8e2b-faab67659775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:36.359315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5d5df-3280-4909-8e2b-faab67659775 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:36.359601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5d5df-3280-4909-8e2b-faab67659775 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:36.359873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5d5df-3280-4909-8e2b-faab67659775 None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:36.360590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5d5df-3280-4909-8e2b-faab67659775 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:36.362020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5d5df-3280-4909-8e2b-faab67659775 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:36.482486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 588/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:10:36 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:10:38.758444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5ba1-73b7-4518-b7e5-5317df5a4341 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:38.758995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5ba1-73b7-4518-b7e5-5317df5a4341 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:38.758995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e5ba1-73b7-4518-b7e5-5317df5a4341 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:38.760436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 586/1174] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:38.765751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:38.766171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:38.766273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:38.783022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:38.784224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:38.846601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 589/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:38.871384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5ba1-73b7-4518-b7e5-5317df5a4341 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:38.966785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e5ba1-73b7-4518-b7e5-5317df5a4341 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:38.998009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f9521-0a53-4ca0-89b7-27f342cebdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:38.998861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f9521-0a53-4ca0-89b7-27f342cebdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:38.999140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f9521-0a53-4ca0-89b7-27f342cebdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:38.999443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f9521-0a53-4ca0-89b7-27f342cebdf3 None admin] PATH_INFO: `/v3/domains/bd3925c15d7942e8934f4ce83e1fb849` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:39.000665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f9521-0a53-4ca0-89b7-27f342cebdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd3925c15d7942e8934f4ce83e1fb849)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:39.002081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f9521-0a53-4ca0-89b7-27f342cebdf3 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:39.003779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 587/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Tue May 3 16:10:38 2022] GET /identity/v3/domains/bd3925c15d7942e8934f4ce83e1fb849 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:39.010713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:39.102776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3efdf1-6bc4-4c54-b14b-788c6304913b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:39.134709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7ed2a-b3d6-4295-85cb-16005c129803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:39.135379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ed2a-b3d6-4295-85cb-16005c129803 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:39.135660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ed2a-b3d6-4295-85cb-16005c129803 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:39.135933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ed2a-b3d6-4295-85cb-16005c129803 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:39.136884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7ed2a-b3d6-4295-85cb-16005c129803 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:39.138294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7ed2a-b3d6-4295-85cb-16005c129803 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:39.235547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 590/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:10:39 2022] POST /identity/v3/users => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:10:41.527613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3147-8d42-4c01-bb20-d3ddf432dc69 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:41.528053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3147-8d42-4c01-bb20-d3ddf432dc69 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:41.528178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3147-8d42-4c01-bb20-d3ddf432dc69 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:41.529543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 588/1178] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:41.534565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:41.534947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:41.535111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:41.551398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:41.552542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:41.616382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 591/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:41.640645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3147-8d42-4c01-bb20-d3ddf432dc69 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:41.735259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3147-8d42-4c01-bb20-d3ddf432dc69 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:41.766465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:41.767173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:41.767479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:41.767752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:41.778246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:10:41.785714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:41.786955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:10:41.788215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 589/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:41.792655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:41.887052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6855301-3fdf-42b0-9487-b9e80881eebc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:41.919100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:41.919774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:41.920053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:41.920322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:41.921052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:41.921351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:41.922689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:41.930886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 592/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:41.936574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:42.029791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb720111-1d90-4b93-ae2a-84ffbe1a0d1e None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:42.062564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:42.063452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:42.063736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:42.064011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] PATH_INFO: `/v3/users/b09056736af04bf6b5dcd03d2a1d300f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:42.077100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=b09056736af04bf6b5dcd03d2a1d300f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:42.078536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:42.080183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 590/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:41 2022] GET /identity/v3/users/b09056736af04bf6b5dcd03d2a1d300f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:42.085813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:42.181212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ebbb-baf6-49cf-b270-0578a04babf7 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:42.211994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:42.212618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:42.212896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:42.213166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:42.276791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:42.278229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:42.370651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 593/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:10:42.376455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:42.470175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fbae-71a9-4a0a-9743-1f9eb7479ea9 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:42.502410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8c279-37db-44cd-8a58-ee479e87ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:42.503266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c279-37db-44cd-8a58-ee479e87ab73 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:42.503557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c279-37db-44cd-8a58-ee479e87ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:42.503830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8c279-37db-44cd-8a58-ee479e87ab73 None admin] PATH_INFO: `/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:42.505023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c279-37db-44cd-8a58-ee479e87ab73 None admin] RBAC: Authorizing `identity:get_project(project_id=9689b3d54f2643d4bc9a301e2d3377ad)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:42.506436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8c279-37db-44cd-8a58-ee479e87ab73 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:42.508126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 591/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:42 2022] GET /identity/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:42.519216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:42.612599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cb046-0c23-41c4-ba94-d41dbf3c6853 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:42.643976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:42.644549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:42.645367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:42.645637 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:42.646441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=9689b3d54f2643d4bc9a301e2d3377ad, user.id=b09056736af04bf6b5dcd03d2a1d300f) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:42.646747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:42.648249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e4d8e-b7ec-4376-b178-5a41710831cb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:42.653466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 594/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:42 2022] GET /identity/v3/role_assignments?user.id=b09056736af04bf6b5dcd03d2a1d300f&scope.project.id=9689b3d54f2643d4bc9a301e2d3377ad&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:44.871611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4e67-e671-4e7d-8b7b-567e19190be9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:44.872143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4e67-e671-4e7d-8b7b-567e19190be9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:44.872143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f4e67-e671-4e7d-8b7b-567e19190be9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:44.873528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 592/1186] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:44.878651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:44.879684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:44.879795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:44.896034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:44.897183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:44.959632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 595/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:44.981340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4e67-e671-4e7d-8b7b-567e19190be9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:45.079764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f4e67-e671-4e7d-8b7b-567e19190be9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:45.110968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:45.111760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:45.112041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:45.112312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:45.122542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:10:45.130529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:45.131693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:10:45.132588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 593/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:45.138024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:45.233344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368df46a-59f8-4bf8-80ca-df104acbbfa2 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:45.265581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:45.266227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:45.266509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:45.266784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:45.267549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:45.267853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:45.269223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:45.277329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 596/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:10:45.283821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:45.380955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b25ff-ab7e-485a-9f34-ff53e6ad9acc None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:45.413163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:45.414017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:45.414302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:45.414580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] PATH_INFO: `/v3/users/b09056736af04bf6b5dcd03d2a1d300f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:45.415769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] RBAC: Authorizing `identity:get_user(user_id=b09056736af04bf6b5dcd03d2a1d300f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:45.417214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:45.418831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 594/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:45 2022] GET /identity/v3/users/b09056736af04bf6b5dcd03d2a1d300f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:45.424548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:45.518567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78248346-19e6-453f-b126-a72468e57fd3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:45.550177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e09be-4e3d-404e-8b5e-697ec27f6bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:45.551888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e09be-4e3d-404e-8b5e-697ec27f6bdb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:45.554253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e09be-4e3d-404e-8b5e-697ec27f6bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:45.554253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e09be-4e3d-404e-8b5e-697ec27f6bdb None admin] PATH_INFO: `/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:45.554253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e09be-4e3d-404e-8b5e-697ec27f6bdb None admin] RBAC: Authorizing `identity:get_project(project_id=9689b3d54f2643d4bc9a301e2d3377ad)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:45.555046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e09be-4e3d-404e-8b5e-697ec27f6bdb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:45.556695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 597/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:45 2022] GET /identity/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:45.562690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:45.668038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02c5a-ce86-48a1-85c2-6ae72a1faffd None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:45.699706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f2e2-3fbe-4854-9280-6f737a15e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:45.700584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f2e2-3fbe-4854-9280-6f737a15e208 None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:45.700866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f2e2-3fbe-4854-9280-6f737a15e208 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:45.701143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f2e2-3fbe-4854-9280-6f737a15e208 None admin] PATH_INFO: `/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad/users/b09056736af04bf6b5dcd03d2a1d300f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:45.703070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f2e2-3fbe-4854-9280-6f737a15e208 None admin] RBAC: Authorizing `identity:create_grant(project_id=9689b3d54f2643d4bc9a301e2d3377ad, user_id=b09056736af04bf6b5dcd03d2a1d300f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:45.704514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f2e2-3fbe-4854-9280-6f737a15e208 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:45.778337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 595/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:10:45 2022] PUT /identity/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad/users/b09056736af04bf6b5dcd03d2a1d300f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:10:47.981399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681b768-b3c5-460b-b450-fc7989e54f03 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:47.981935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681b768-b3c5-460b-b450-fc7989e54f03 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:47.981935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681b768-b3c5-460b-b450-fc7989e54f03 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:47.983332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 598/1193] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:10:47.988549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:47.989049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:47.989141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:48.005210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:10:48.006362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:10:48.068828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 596/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:10:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:10:48.091659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681b768-b3c5-460b-b450-fc7989e54f03 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:48.187993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681b768-b3c5-460b-b450-fc7989e54f03 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:48.219620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:48.220379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:48.220658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:48.220934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:48.230905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:10:48.238585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:10:48.239624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:10:48.240780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 599/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:10:48.245655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:48.343039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bd324-bf0d-48fa-b55d-166743e147fd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:48.376879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:48.377539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:48.377819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:48.378090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:48.379920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:48.380230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:48.381611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:48.389782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 597/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:48.396441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:48.492118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11412c6a-4abb-402a-970b-8d2eeb506659 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:48.525691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:48.526561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:48.526842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:48.527116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] PATH_INFO: `/v3/users/b09056736af04bf6b5dcd03d2a1d300f` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:48.528326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=b09056736af04bf6b5dcd03d2a1d300f)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:48.529768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:48.531451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 600/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue May 3 16:10:48 2022] GET /identity/v3/users/b09056736af04bf6b5dcd03d2a1d300f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:48.537397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:48.635567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896658a-8b6a-4d2a-b5f1-a44af2a42c65 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:48.668440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:48.669082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:48.669365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:48.669665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:48.733973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:48.735429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:48.828369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 598/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:10:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:10:48.834529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:48.929757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16989c-5711-4c09-81fa-21517730c0f9 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:48.962039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97971-6586-4904-9d89-ae5bae98dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:48.962875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97971-6586-4904-9d89-ae5bae98dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:48.963156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97971-6586-4904-9d89-ae5bae98dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:48.963460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97971-6586-4904-9d89-ae5bae98dc8e None admin] PATH_INFO: `/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:48.964619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97971-6586-4904-9d89-ae5bae98dc8e None admin] RBAC: Authorizing `identity:get_project(project_id=9689b3d54f2643d4bc9a301e2d3377ad)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:48.966018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97971-6586-4904-9d89-ae5bae98dc8e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:48.967707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 601/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue May 3 16:10:48 2022] GET /identity/v3/projects/9689b3d54f2643d4bc9a301e2d3377ad => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:10:48.974282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:10:49.068690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27595d-583a-47bd-9781-f657cd2d64b2 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:10:49.100759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:10:49.101343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:10:49.101628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:10:49.101906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:10:49.102719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=9689b3d54f2643d4bc9a301e2d3377ad, user.id=b09056736af04bf6b5dcd03d2a1d300f) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:10:49.103032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:10:49.104487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712ac36-0600-408d-adfc-39e8f12c9d3c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:10:49.110063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 599/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:10:48 2022] GET /identity/v3/role_assignments?user.id=b09056736af04bf6b5dcd03d2a1d300f&scope.project.id=9689b3d54f2643d4bc9a301e2d3377ad&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:10.806761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e14d-ab7c-4d63-b526-922719da3e69 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:10.807454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e14d-ab7c-4d63-b526-922719da3e69 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:10.807454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e14d-ab7c-4d63-b526-922719da3e69 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:10.808792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 602/1201] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:10.814067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578399-1549-479b-894e-df681fd405f1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:10.814552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578399-1549-479b-894e-df681fd405f1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:10.814655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578399-1549-479b-894e-df681fd405f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:10.831757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5f578399-1549-479b-894e-df681fd405f1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:10.833587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5f578399-1549-479b-894e-df681fd405f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:10.897885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 600/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:10.922726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e14d-ab7c-4d63-b526-922719da3e69 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:11.022457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e14d-ab7c-4d63-b526-922719da3e69 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:11.056338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:11.057299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:11.057553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:11.057848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:11.067628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:11.069114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:11.086619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:11.094538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:11.095902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:11.095902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:11.095902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:11.095902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:11.095902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 603/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:11.096292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578399-1549-479b-894e-df681fd405f1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:11.190226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578399-1549-479b-894e-df681fd405f1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:11.223609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:11.224262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:11.224545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:11.224823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:11.226221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:11.226529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:11.228048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1a244-bda6-41ed-8547-1104db1b91b7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:11.241919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 601/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:11.247690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:11.348801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38abf7c-66e1-4a41-867d-45d831894894 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:11.381678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69484a0-d953-4097-8752-b3793ab20648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:11.382334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69484a0-d953-4097-8752-b3793ab20648 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:11.382612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69484a0-d953-4097-8752-b3793ab20648 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:11.382881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69484a0-d953-4097-8752-b3793ab20648 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:11.383705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69484a0-d953-4097-8752-b3793ab20648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:11.385111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69484a0-d953-4097-8752-b3793ab20648 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:11.459174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 604/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Tue May 3 16:12:11 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:12:13.758786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf955-6b5d-48c0-ba1f-072e0bfedb25 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:13.759381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf955-6b5d-48c0-ba1f-072e0bfedb25 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:13.759381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf955-6b5d-48c0-ba1f-072e0bfedb25 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:13.760706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 602/1206] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:12:13.765837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:13.766280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:13.766373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:13.784133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:13.785444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:13.850059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 605/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:13.874438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf955-6b5d-48c0-ba1f-072e0bfedb25 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:13.973453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf955-6b5d-48c0-ba1f-072e0bfedb25 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.006319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.007181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.007488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.007760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:14.018029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:12:14.025457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:14.026579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:14.027636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 603/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:14.032741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:14.128990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaef56-3fed-4b7d-a5a1-27e4385e2f0e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.161107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.161761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.162038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.162305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:14.163814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:14.164113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:14.165499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:14.173136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 606/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:14.179885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:14.278765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568af1a5-9a43-44b9-bccc-0513e6fc16db None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.311707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.312496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.312779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.313050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:14.323127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:14.324599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:14.341850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:14.342969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:14.349028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:14.349028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:14.349028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:14.349028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:14.349028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 604/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:14.349385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:14.445170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2647d91-a043-4392-8ece-f0dc0c03dfd3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.477799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.478458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.478734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.479010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:14.479747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:14.480052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:14.481439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:14.493070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 607/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:14.498745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:14.597479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e200a-21b4-4150-b5cb-eda40814a9d0 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.629613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.630401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.630679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.630948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:14.638839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:14.640300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:12:14.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:14.656224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:14.657232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 605/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:14.662191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:14.760008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f12468-1a9e-4496-93b5-a334e085a7a6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.792900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.793558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.793837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.794107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:14.794919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:14.795222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:14.796729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:14.812934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 608/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Tue May 3 16:12:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:14.818550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:14.915030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0de8a3-9975-4a54-8346-f0732a70811d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:14.948168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:14.948812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:14.949093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:14.949365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:15.015566 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:15.016992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:15.111087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 606/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:12:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 16:12:15.117668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:15.214344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08c7f-211e-437d-a371-a44e290a0f56 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:15.247800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:15.248603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:15.248894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:15.249239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:15.259986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:15.261432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:15.279546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:15.280627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:15.281630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:15.281630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:15.281630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:15.281630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:15.281630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 609/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:15.286624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:15.380856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa93d79-3175-4bf0-9aed-29d979270ba8 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:15.412739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:15.414070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:15.414356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:15.414629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:15.415362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:15.415662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:15.417056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:15.428092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 607/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:15.434607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:15.529693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e07076-6288-42f5-9428-fa531cfa61a3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:15.563703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:15.564483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:15.564764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:15.565036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:15.571474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:15.572894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:12:15.586346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:15.588730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:15.589846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 610/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:15.593534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:15.690209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3777c76-0fb5-4163-8557-f7e1ab082009 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:15.724489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:15.725199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:15.725526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:15.726549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:15.727277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:15.727628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:15.729101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6357-1ddd-4b03-916f-61920b2fe35e None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:15.741521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 608/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:15.747644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:15.844367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e3ba-2a2f-4637-89bc-b82e03bd8214 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:15.875647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:15.876286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:15.876564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:15.876832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:15.877638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=16fc7e5d900a487d83be32cd8c2ffbfb) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:15.877941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:15.879427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f104dd-41d7-4dc6-9344-c2e70f21c2bf None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:15.884866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 611/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:12:15 2022] GET /identity/v3/role_assignments?user.id=16fc7e5d900a487d83be32cd8c2ffbfb&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:18.123354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abc121-33a2-488a-bb44-b96d513cd051 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:18.123899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abc121-33a2-488a-bb44-b96d513cd051 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:18.124027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abc121-33a2-488a-bb44-b96d513cd051 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:18.125307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 609/1220] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:18.130468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:18.131142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:18.131338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:18.148412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:18.150906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:18.231509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 612/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:18.254513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abc121-33a2-488a-bb44-b96d513cd051 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:18.353061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abc121-33a2-488a-bb44-b96d513cd051 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:18.387936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:18.388700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:18.388986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:18.389297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:18.400130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:12:18.407746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:18.408937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:18.410005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 610/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:18.415213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:18.515803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4901-705d-4fbc-83f2-59270345ae0d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:18.548673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:18.549321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:18.549599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:18.549868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:18.550599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] RBAC: Adding query filter params (name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:18.550897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:18.552272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:18.560274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 613/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:12:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:18.566218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:18.665278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782dcf-352b-4f56-9f6b-1ae5acf5641d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:18.697213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:18.697987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:18.698266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:18.698538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:18.709241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:18.711237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:18.727504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:18.728571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:18.729565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:18.729565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:18.729565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:18.729565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:18.729565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 611/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:18.734573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:18.831386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f8258-84f3-41cf-88b0-35330c99b90a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:18.862715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:18.863523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:18.863804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:18.864075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:18.864774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:18.865072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:18.866964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:18.878235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 614/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:18.885187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:18.979578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5322-b791-44ee-a67e-176a914d3944 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:19.011914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:19.012693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:19.012970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:19.013241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:19.020296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:19.021720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:12:19.035351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:19.036596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:19.037802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 612/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:19.042482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:19.140213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be5654-88a3-4a1a-9201-688f5dabe81c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:19.172425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:19.173078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:19.173357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:19.173627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:19.174440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:19.174742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:19.176184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:19.192946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 615/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Tue May 3 16:12:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:19.198845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:19.306182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52fc1-ec0f-4257-b071-15a36cb0e620 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:19.340066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:19.340850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:19.341134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:19.341416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:19.352506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:19.360565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:19.371371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:19.372467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:19.373593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:19.373593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:19.373593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:19.373593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:19.373593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 613/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:19.378264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:19.481580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0d3b4-9781-452b-8c78-b9afe0173a5a None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:19.517841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:19.518503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:19.518781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:19.519053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:19.519800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:19.520253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:19.522249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:19.537496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 616/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:19.544485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:19.653245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade373fc-f012-495d-9ab8-fcf37749df59 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:19.687811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:19.688601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:19.688883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:19.689157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:19.696143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:19.697576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:12:19.713056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:19.714318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:19.715641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 614/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:19.720188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:19.823442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81922e-265c-4d67-b90b-88c23a0b18bb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:19.858822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:19.859597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:19.859878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:19.860151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:19.860926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:19.861231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:19.862655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97da806-2c91-4f60-bf70-b2936c70be9d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:19.874805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 617/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:12:19.881116 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:19.988288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d6d1c-c9eb-44a5-958f-688efd686b1f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:20.023954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d6a7-991d-495c-b0e5-d140ae3803e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:20.024850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d6a7-991d-495c-b0e5-d140ae3803e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:20.025136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d6a7-991d-495c-b0e5-d140ae3803e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:20.025412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d6a7-991d-495c-b0e5-d140ae3803e9 None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/16fc7e5d900a487d83be32cd8c2ffbfb/roles/35e8c8927b1f46b5b0fbc6832b9b5660` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:20.041739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d6a7-991d-495c-b0e5-d140ae3803e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=16fc7e5d900a487d83be32cd8c2ffbfb, role_id=35e8c8927b1f46b5b0fbc6832b9b5660)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:20.043748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d6a7-991d-495c-b0e5-d140ae3803e9 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:20.117416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 615/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:12:19 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/16fc7e5d900a487d83be32cd8c2ffbfb/roles/35e8c8927b1f46b5b0fbc6832b9b5660 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:12:22.417460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef666ac-e6cb-4bda-b851-2561c4300b89 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:22.418020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef666ac-e6cb-4bda-b851-2561c4300b89 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:22.418020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef666ac-e6cb-4bda-b851-2561c4300b89 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:22.419394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 618/1233] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:22.424887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:22.426284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:22.426284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:22.442012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:22.443197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:22.510831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 616/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:22.542095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef666ac-e6cb-4bda-b851-2561c4300b89 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:22.641953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef666ac-e6cb-4bda-b851-2561c4300b89 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:22.674691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:22.675455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:22.675738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:22.676010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:22.686413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:12:22.694742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:22.695899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:22.696819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 619/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Tue May 3 16:12:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:22.701986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:22.799034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597a27-decd-4804-8ced-b76426618c81 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:22.833305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:22.833987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:22.834279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:22.834577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:22.835508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] RBAC: Adding query filter params (name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:22.835818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:22.837202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:22.845402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 617/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Tue May 3 16:12:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:22.851743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:22.947939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c342-a150-4f96-90d7-cacf225a0f13 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:22.979792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:22.980570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:22.980853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:22.981128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:22.992636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:22.994238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:23.011269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:23.012428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:23.013557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:23.013557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:23.013557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:23.013557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:23.013557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 620/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:23.018110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:23.115066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945c91-ca39-462f-a47d-cd54a4970132 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:23.148200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:23.148840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:23.149122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:23.149394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:23.150096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:23.150398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:23.151792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:23.162391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 618/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:23.168511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:23.267164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e01f5-3ba1-48bd-ae26-65c5498aace3 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:23.299487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:23.300267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:23.300547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:23.300814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:23.307896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:23.309306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:12:23.323212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:23.324322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:23.325717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 621/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:23.330140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:23.427029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c78bd-fe76-4f3e-9238-c2f54b1f1d44 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:23.458913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:23.460245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:23.460526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:23.460928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:23.461754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:23.462063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:23.463512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:23.480799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 619/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Tue May 3 16:12:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:23.486576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:23.585051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5e0a0-499b-4569-894a-3108a6adc4d0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:23.619372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:23.620020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:23.620295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:23.620568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:23.685355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:23.686890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:23.780625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 622/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:12:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:12:23.786578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:23.886099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef444b9-a509-44ce-8262-71cb0c68c867 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:23.918672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:23.919472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:23.919753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:23.920032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:23.929653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:23.931090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:23.949127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:23.950052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:23.950949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:23.950949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:23.950949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:23.950949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:23.950949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 620/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:23.956379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:24.051670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f52d7b-3eee-4d58-9dcf-622d43b79370 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:24.084504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:24.085191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:24.085472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:24.085744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:24.086439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:24.086737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:24.088118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:24.098815 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 623/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:24.104669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:24.201008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73810dd1-6598-432c-bcc3-1185da4f7921 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:24.233131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:24.233940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:24.234231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:24.234511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:24.241553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:24.243090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:12:24.257495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:24.258564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:24.259981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 621/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:24.264432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:24.360933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e9b2-cdc5-4aec-ab4c-d4f0448f5784 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:24.393114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:24.393763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:24.394041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:24.394312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:24.395077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:24.395463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:24.396839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d73ee-6353-4c77-af05-d4959e013cdb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:24.408363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 624/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:24.414978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:24.512719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3393e52-2d34-4277-a9d1-accce31b406c None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:24.545749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:24.546388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:24.546669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:24.546943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:24.547789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] RBAC: Adding query filter params (role.id=35e8c8927b1f46b5b0fbc6832b9b5660, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=16fc7e5d900a487d83be32cd8c2ffbfb) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:24.548095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:24.549501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09a394-f710-4886-b45b-8aaec962f873 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:24.556195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 622/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:12:24 2022] GET /identity/v3/role_assignments?user.id=16fc7e5d900a487d83be32cd8c2ffbfb&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=35e8c8927b1f46b5b0fbc6832b9b5660 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:26.868414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7daea-2dc1-44fa-ac8e-086aa46a172a None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:26.869004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7daea-2dc1-44fa-ac8e-086aa46a172a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:26.869164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7daea-2dc1-44fa-ac8e-086aa46a172a None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:26.870821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 625/1247] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:26.876788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:26.877200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:26.877348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:26.895155 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:26.896386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:26.962053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 623/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:26.985174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7daea-2dc1-44fa-ac8e-086aa46a172a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:27.086270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7daea-2dc1-44fa-ac8e-086aa46a172a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:27.119612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:27.120334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:27.120638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:27.120911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:27.130936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:12:27.139201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:27.140226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:27.141095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 626/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:27.146605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:27.246244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d8e7-ad75-4834-8dc6-93ade7269d0c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:27.279301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:27.279967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:27.280251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:27.280529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:27.281268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:27.281575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:27.282949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:27.291457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 624/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:27.297385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:27.396193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16dc49-7d17-4dc7-84d3-a30213565797 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:27.428904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:27.429893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:27.430091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:27.430365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:27.440717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:27.442177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:27.458582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:27.463969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:27.464869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:27.464869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:27.464869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:27.464869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:27.464869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 627/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:27.465679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:27.584521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dff47-facd-490e-96bc-65d9536c314a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:27.617491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:27.618140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:27.618420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:27.618694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:27.619425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:27.619729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:27.621084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:27.633035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 625/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:27.638791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:27.736139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172932-008b-4d15-b35f-aeb61572800d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:27.768401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:27.769192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:27.769473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:27.769748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:27.777770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:27.779191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:12:27.793572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:27.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:27.795987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 628/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:27.800569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:27.911018 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d681a2e-b287-4ccd-a00c-b344421ed1aa None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:27.944439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:27.945110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:27.945395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:27.945668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:27.946486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:27.946793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:27.948330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:27.965062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 626/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Tue May 3 16:12:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:27.971168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:28.067848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88669e-7c39-4d6b-a91a-4e8de198beb0 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:28.099800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:28.101038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:28.101323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:28.101623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:28.166012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:28.167480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:28.262391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 629/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:12:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:12:28.268197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:28.363305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4581a-b7dc-4cb0-9084-7918b584a9cd None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:28.396207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:28.397078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:28.397364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:28.397639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:28.407309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:28.408786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:28.426423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:28.427522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:28.429360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:28.429360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:28.429360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:28.429360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:28.429360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 627/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:28.433898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:28.531051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcec2d-39bc-4c04-95b1-897483660c8b None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:28.564488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:28.565140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:28.565420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:28.565682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:28.566385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:28.566682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:28.568053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:28.578868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 630/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:28.585205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:28.679397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d709707-091c-4dd0-bb54-0cb679d30612 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:28.711161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:28.711962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:28.712242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:28.712510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:28.718933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:28.720407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:12:28.734319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:28.736853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:28.737992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 628/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:28.741642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:28.840971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380caa8-878b-48f5-8731-058943f01ca5 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:28.874561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:28.875220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:28.875566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:28.875840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:28.876650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:28.879580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:28.879580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad106-0bb4-4339-9fbe-019e5a7f0dff None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:28.891619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 631/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:28.898221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:28.993297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c3686-8e99-41e2-846b-b195986e0700 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:29.026248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:29.026886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:29.027169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:29.027471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:29.028295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=16fc7e5d900a487d83be32cd8c2ffbfb) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:29.034188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:29.034188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c352-8f27-407c-a145-26b3bec588fc None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:29.035213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 629/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:12:28 2022] GET /identity/v3/role_assignments?user.id=16fc7e5d900a487d83be32cd8c2ffbfb&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:31.267810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c085f2-41a5-4c0d-8512-97e1be62e656 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:31.268448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c085f2-41a5-4c0d-8512-97e1be62e656 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:31.268448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c085f2-41a5-4c0d-8512-97e1be62e656 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:31.269721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 632/1261] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:31.275282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:31.275828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:31.275828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:31.292711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:31.293882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:31.357153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 630/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:31.379878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c085f2-41a5-4c0d-8512-97e1be62e656 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:31.478513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c085f2-41a5-4c0d-8512-97e1be62e656 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:31.511090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:31.511909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:31.512205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:31.512461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:31.523095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:12:31.530493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:31.531701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:31.532661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 633/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:31.538736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:31.634515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a628-b3f6-48cb-8bdd-43830e859df4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:31.667658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:31.668352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:31.668633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:31.668906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:31.669641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:31.669943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:31.671338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:31.679101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 631/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:31.685158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:31.782713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ad355-8075-4ef9-9cfc-9182549f3a75 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:31.814886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:31.815694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:31.816074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:31.816291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:31.827786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:31.829305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:31.846546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:31.858768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:31.859901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:31.859901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:31.859901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:31.859901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:31.859901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 634/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:31.860268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:31.951601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c574-a697-48a6-9d82-df0aefed4a13 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:31.985007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:31.985662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:31.985944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:31.986218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:31.986921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:31.987224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:31.988612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.000136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 632/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:32.006061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:32.102833 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325abab-fc22-48a5-8975-c9ec37bcb0d6 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:32.135378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:32.136173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:32.136478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:32.136759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:32.143993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:32.145424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:12:32.159907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:32.164931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:32.166079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 635/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:32.167125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:32.264980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0ece-7f22-489f-8da0-8a35d73559a7 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:32.297369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:32.298023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:32.298302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:32.298573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:32.299426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:32.299732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:32.301130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.318068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 633/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Tue May 3 16:12:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:32.324448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:32.420447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770ca5e-f1ee-4f12-866a-e18b0593dc5d None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:32.453130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:32.453905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:32.454187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:32.454462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:32.465095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:32.466523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:32.483247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:32.484361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:32.486660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:32.486660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:32.486660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:32.486660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:32.486660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 636/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:32.490057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:32.588667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8334c-e213-4be6-ae65-fb9a4dac6f0f None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:32.622188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:32.622840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:32.623123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:32.623430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:32.624138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:32.624475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:32.625808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.637413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 634/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:32.643110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:32.739204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0199f-4114-494e-a259-bb621da5e485 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:32.771068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:32.771875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:32.772158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:32.772428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:32.778814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:32.780266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:12:32.794455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:32.795538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:32.796653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 637/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:32.801487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:32.898154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c144b7-84b6-4249-b49c-550f5e3ebe04 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:32.931450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:32.932105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:32.932389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:32.932666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:32.933441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:32.933752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:32.935298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97daf37-11fe-4b03-b869-47f8bc19e4ff None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:32.948486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 635/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:32.954353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:33.052966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de8d1-4895-46de-9ede-52ccc28025eb None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:33.084616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414693-2f61-4a53-948d-f02d06b52621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:33.086018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414693-2f61-4a53-948d-f02d06b52621 None admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:33.086301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414693-2f61-4a53-948d-f02d06b52621 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:33.086650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414693-2f61-4a53-948d-f02d06b52621 None admin] PATH_INFO: `/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/16fc7e5d900a487d83be32cd8c2ffbfb/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:33.088590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414693-2f61-4a53-948d-f02d06b52621 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6c055ef88fb4f6485c8fe60c312adbd, user_id=16fc7e5d900a487d83be32cd8c2ffbfb, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:33.090035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414693-2f61-4a53-948d-f02d06b52621 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:33.189310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 638/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Tue May 3 16:12:32 2022] PUT /identity/v3/projects/c6c055ef88fb4f6485c8fe60c312adbd/users/16fc7e5d900a487d83be32cd8c2ffbfb/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:12:35.408819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90928-0ca3-4326-a9f5-29c85c2838e9 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:35.409354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90928-0ca3-4326-a9f5-29c85c2838e9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:35.409447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90928-0ca3-4326-a9f5-29c85c2838e9 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:35.410769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 636/1274] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:35.416155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:35.416545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:35.416798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:35.434316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:35.435542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:35.501960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 639/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:35.523906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90928-0ca3-4326-a9f5-29c85c2838e9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:35.622122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90928-0ca3-4326-a9f5-29c85c2838e9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:35.654079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:35.654861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:35.655141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:35.655446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:35.665838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 16:12:35.673339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:35.674388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:35.675423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 637/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Tue May 3 16:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:35.681253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:35.777522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baede04-3e82-4d5e-9c5c-fe1f0f715a0b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:35.810872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:35.811552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:35.811834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:35.812107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:35.812846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:35.813146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:35.814588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:35.822812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 640/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Tue May 3 16:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:35.828292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:35.927556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d69d6-97eb-48ac-bd6c-5b43ef80b977 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:35.960434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:35.961220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:35.962075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:35.962381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:35.972923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:35.974391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:35.991872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:35.992932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:35.994023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:35.994023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:35.994023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:35.994023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:35.994023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 638/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:35.999009 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:36.096944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3f446-5fb5-496d-93fd-6d3c814ad02f None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:36.130319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:36.130972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:36.131294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:36.131577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:36.132286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:36.132592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:36.134002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:36.145362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 641/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:36.151935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:36.250685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8fd2-8aee-43af-a2c3-820dd000ef2a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:36.283151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:36.283985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:36.284270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:36.284545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:36.292617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:36.295418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 16:12:36.308333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:36.309444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:36.310788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 639/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 16:12:36.315385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:36.410299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a34f9-a0e7-480e-bb33-1ddacd5b7797 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:36.441883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:36.442547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:36.442823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:36.443093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:36.443943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:36.444247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:36.445720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:36.463193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 642/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Tue May 3 16:12:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:36.468921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:36.565859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f2cf9-e8d3-40be-b10c-36b811c42a50 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:36.599471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:36.600110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:36.600387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:36.600656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:36.665530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:36.666961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:36.764117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 640/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Tue May 3 16:12:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 16:12:36.769825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:36.863766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aad616-28ef-4f4d-8949-992b5f649d47 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:36.896668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:36.897441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:36.897719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:36.897987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:36.907987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:36.910922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 16:12:36.927051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:36.928058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:36.928978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 16:12:36.928978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 16:12:36.928978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 16:12:36.928978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:36.928978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 643/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:36.935023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:37.030870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ecb1-dd65-44bc-83de-8428cc8e7b6d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:37.064603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:37.065261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:37.065543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:37.065949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:37.066664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:37.066973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:37.068423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:37.079375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 641/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Tue May 3 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:37.084989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:37.180208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e736c-f265-4e64-8bb1-47021e18f733 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:37.212107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:37.212882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:37.213195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:37.213473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:37.220002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:37.221456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 16:12:37.235822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application with Lock( May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:37.236942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: ERROR keystone.server.flask.application May 03 16:12:37.238078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 644/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Tue May 3 16:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:37.243551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:37.351726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0783-43a9-4968-bbe4-409a3595f908 None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:37.385379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:37.386038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:37.386323 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:37.386605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:37.387417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:37.387732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:37.389168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836b2c-8a32-4ecf-a51a-33909cdbe38d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:37.402103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 642/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Tue May 3 16:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:37.408152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:37.512256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d598-1faa-40dc-b660-72d091bc759c None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:37.546492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:37.547136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:37.547455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:37.547733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:37.548588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] RBAC: Adding query filter params (role.id=36b9f0766a244c95b8c245ea734587b4, scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd, user.id=16fc7e5d900a487d83be32cd8c2ffbfb) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:37.548896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:37.550309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ce49a-3137-4880-9c05-5a6d7c6483c5 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:37.556069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 645/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Tue May 3 16:12:37 2022] GET /identity/v3/role_assignments?user.id=16fc7e5d900a487d83be32cd8c2ffbfb&scope.project.id=c6c055ef88fb4f6485c8fe60c312adbd&role.id=36b9f0766a244c95b8c245ea734587b4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:39.825636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0e019-15c8-4152-868c-0cdac8832afe None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:39.826211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0e019-15c8-4152-868c-0cdac8832afe None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:39.826211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0e019-15c8-4152-868c-0cdac8832afe None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:39.827596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 643/1288] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:39.832627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:39.833057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:39.833185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:39.850124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:39.851335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:39.915871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 646/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:39.938258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0e019-15c8-4152-868c-0cdac8832afe None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:40.039606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0e019-15c8-4152-868c-0cdac8832afe None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:40.073703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027342-9fef-4589-b337-404ff345175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:40.074493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027342-9fef-4589-b337-404ff345175d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:40.074777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027342-9fef-4589-b337-404ff345175d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:40.075054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027342-9fef-4589-b337-404ff345175d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:40.075776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027342-9fef-4589-b337-404ff345175d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:40.077095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027342-9fef-4589-b337-404ff345175d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-7d027342-9fef-4589-b337-404ff345175d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:40.089746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:40.091168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:40.092437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 644/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:12:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:40.097121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:40.194232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987385b1-d33e-4a02-926a-e6c872a89850 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:40.228764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:40.229415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:40.229698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:40.229972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:40.230671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:40.230973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:40.232354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae87db8-9248-4749-8e35-400da697e737 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:40.237056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 647/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Tue May 3 16:12:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:12:40.242802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027342-9fef-4589-b337-404ff345175d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:40.346470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027342-9fef-4589-b337-404ff345175d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:40.378752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:40.379435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:40.379720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:40.380266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] PATH_INFO: `/v3/services` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:40.380962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:40.381269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:40.382626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452a06a-ddce-495e-89bf-55dcd2a27788 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:40.388073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 645/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Tue May 3 16:12:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:42.609827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c933-5a77-4f7e-a6ff-fb229a6e4641 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:42.610354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c933-5a77-4f7e-a6ff-fb229a6e4641 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:42.610466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c933-5a77-4f7e-a6ff-fb229a6e4641 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:42.611829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 648/1293] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:42.616988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de362fb-4531-4372-834f-4dc8c4440bcd None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:42.617412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de362fb-4531-4372-834f-4dc8c4440bcd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:42.617546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de362fb-4531-4372-834f-4dc8c4440bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:42.634811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3de362fb-4531-4372-834f-4dc8c4440bcd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:42.635996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3de362fb-4531-4372-834f-4dc8c4440bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:42.699711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 646/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:42.722779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c933-5a77-4f7e-a6ff-fb229a6e4641 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:42.820432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c933-5a77-4f7e-a6ff-fb229a6e4641 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:42.854065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216921ea-fd85-4c56-9928-9268f1d6fcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:42.854732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216921ea-fd85-4c56-9928-9268f1d6fcc4 None admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:42.855015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216921ea-fd85-4c56-9928-9268f1d6fcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:42.855323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216921ea-fd85-4c56-9928-9268f1d6fcc4 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:42.856036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216921ea-fd85-4c56-9928-9268f1d6fcc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:42.857452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216921ea-fd85-4c56-9928-9268f1d6fcc4 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:43.030694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 649/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Tue May 3 16:12:42 2022] POST /identity/v3/services => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:12:45.337896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773657d-1909-48bb-a193-b09c4704a427 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:45.338440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773657d-1909-48bb-a193-b09c4704a427 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:45.338440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773657d-1909-48bb-a193-b09c4704a427 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:45.339867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 647/1296] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:45.345123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:45.345579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:45.345676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:45.362486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:45.363699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:45.436424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 650/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:45.459364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773657d-1909-48bb-a193-b09c4704a427 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:45.558292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773657d-1909-48bb-a193-b09c4704a427 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:45.590336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:45.591059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:45.591366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:45.591642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:45.592276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:45.593633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:45.605945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:45.607485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:45.608392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 648/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:12:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:45.613455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:45.705662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01452f5a-7d27-413f-8317-f8d848584972 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:45.739549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:45.740206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:45.740491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:45.740768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:45.741468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:45.741777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:45.743410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:45.748469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 651/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Tue May 3 16:12:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:12:45.754477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:45.854401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00a35-af36-4273-98b7-dfb34b2ed90a None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:45.886213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:45.886856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:45.887135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:45.887432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:45.888203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] RBAC: Adding query filter params (interface=public, service_id=97c8d5d7d7394d448d33ae84be7bd834, region_id=RegionOne) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:45.888506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:45.889850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a261f-d53f-4c74-ab62-1937b02eca60 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:45.894603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 649/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Tue May 3 16:12:45 2022] GET /identity/v3/endpoints?service_id=97c8d5d7d7394d448d33ae84be7bd834&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:45.900842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:45.994543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e8296-1765-49b3-8b40-d46f76d4ac28 None admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:46.026963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998baa4-f3a2-4e78-9822-76be480cde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:46.027648 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998baa4-f3a2-4e78-9822-76be480cde54 None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:46.027934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998baa4-f3a2-4e78-9822-76be480cde54 None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:46.028205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998baa4-f3a2-4e78-9822-76be480cde54 None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:46.028879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998baa4-f3a2-4e78-9822-76be480cde54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:46.030238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998baa4-f3a2-4e78-9822-76be480cde54 None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:46.036873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 652/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Tue May 3 16:12:45 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:12:48.233194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc20ac-9ee8-4860-8c74-cb492e52be44 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:48.233792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc20ac-9ee8-4860-8c74-cb492e52be44 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:48.233792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc20ac-9ee8-4860-8c74-cb492e52be44 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:48.235141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 650/1302] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:12:48.240216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:48.240601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:48.240768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:48.257258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:12:48.258429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:12:48.320693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 653/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:12:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 16:12:48.344233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc20ac-9ee8-4860-8c74-cb492e52be44 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:48.442199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc20ac-9ee8-4860-8c74-cb492e52be44 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:48.474656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:48.475490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:48.475775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:48.476061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:48.476708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:48.478113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 16:12:48.489745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 16:12:48.491094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.get_or_create( May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application with Lock( May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self._enter() May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application return self.creator() May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application created_value = creator( May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: ERROR keystone.server.flask.application May 03 16:12:48.492288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 651/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue May 3 16:12:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 16:12:48.497202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:48.593660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6937-292f-43e5-a212-5fe26a0620f2 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:48.625462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:48.626107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:48.626389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:48.626664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] PATH_INFO: `/v3/services` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:48.627388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:12:48.627694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:48.629061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144975a1-d09c-4d9a-b278-2f5cbc56460e None admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:48.634753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 654/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Tue May 3 16:12:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:12:48.640720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:12:48.736110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320648dd-a37e-42ef-8791-2877bfcdb89d None admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:12:48.768421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aecc03-159a-4665-a6ad-d3a817d613b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:12:48.768995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aecc03-159a-4665-a6ad-d3a817d613b5 None admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:12:48.769275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aecc03-159a-4665-a6ad-d3a817d613b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:12:48.769546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aecc03-159a-4665-a6ad-d3a817d613b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:12:48.770263 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aecc03-159a-4665-a6ad-d3a817d613b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:12:48.771631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aecc03-159a-4665-a6ad-d3a817d613b5 None admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:12:48.915976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 652/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue May 3 16:12:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:19:30.759476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a774a4-e9bd-46b6-bffc-5060efc5197e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:30.760584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a774a4-e9bd-46b6-bffc-5060efc5197e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:30.761361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a774a4-e9bd-46b6-bffc-5060efc5197e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:30.771409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cfb12-b685-4fa3-89b7-68af0d6eec20 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:30.772613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cfb12-b685-4fa3-89b7-68af0d6eec20 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:30.773166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cfb12-b685-4fa3-89b7-68af0d6eec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:30.777032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 655/1307] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:30 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:30.873439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e42cfb12-b685-4fa3-89b7-68af0d6eec20 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:30.874770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e42cfb12-b685-4fa3-89b7-68af0d6eec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:30.990227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 653/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:19:31.040671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec616d-4a13-44c1-b9d2-4c5693cfdd55 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:31.041491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec616d-4a13-44c1-b9d2-4c5693cfdd55 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:31.042467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec616d-4a13-44c1-b9d2-4c5693cfdd55 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:31.044766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 656/1309] 10.222.0.42 () {54 vars in 964 bytes} [Tue May 3 16:19:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:31.050633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95219-dc75-4209-b321-03d89a0e9361 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:31.051115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95219-dc75-4209-b321-03d89a0e9361 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:31.051447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95219-dc75-4209-b321-03d89a0e9361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:31.130232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-82d95219-dc75-4209-b321-03d89a0e9361 None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:31.131496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-82d95219-dc75-4209-b321-03d89a0e9361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:31.224230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 654/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Tue May 3 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:31.233842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec616d-4a13-44c1-b9d2-4c5693cfdd55 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:31.236151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1dec616d-4a13-44c1-b9d2-4c5693cfdd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:31.358269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec616d-4a13-44c1-b9d2-4c5693cfdd55 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:31.447490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:31.449051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:31.449730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:31.450226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:31.453861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:31.594537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:31.596413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0994f-7a01-4977-967b-98a4365b130a service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:31.619542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 657/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:34.233347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b3770-3ae5-4b69-8337-59b9cfefab98 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:34.233897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b3770-3ae5-4b69-8337-59b9cfefab98 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:34.234138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b3770-3ae5-4b69-8337-59b9cfefab98 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:34.235773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 655/1312] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:34.241266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff77d1-9001-41b0-9078-5f72d072de05 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:34.241680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff77d1-9001-41b0-9078-5f72d072de05 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:34.241892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff77d1-9001-41b0-9078-5f72d072de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:34.317798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e5ff77d1-9001-41b0-9078-5f72d072de05 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:34.319951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e5ff77d1-9001-41b0-9078-5f72d072de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:34.425904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 658/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:34.465078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b3770-3ae5-4b69-8337-59b9cfefab98 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:34.467144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c75b3770-3ae5-4b69-8337-59b9cfefab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:34.577869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b3770-3ae5-4b69-8337-59b9cfefab98 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:34.651895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:34.652546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:34.652837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:34.653117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:34.655390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:34.760757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:34.762119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64cd0-336b-4ba6-a816-5e1e100d112a service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:34.781459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 656/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:37.581582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2674-c887-4780-82fe-15a58229ecdb None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:37.582275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2674-c887-4780-82fe-15a58229ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:37.582275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2674-c887-4780-82fe-15a58229ecdb None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:37.583755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 659/1315] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:37.588813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84b84f-9e67-4550-95de-237c2cc1ae86 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:37.589553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84b84f-9e67-4550-95de-237c2cc1ae86 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:37.589833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84b84f-9e67-4550-95de-237c2cc1ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:37.652487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bc84b84f-9e67-4550-95de-237c2cc1ae86 None None] MFA Rules not processed for user `6439f896de0f426b8c65c2ee40200b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:37.653817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bc84b84f-9e67-4550-95de-237c2cc1ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:37.747013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 657/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:37.786045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff2674-c887-4780-82fe-15a58229ecdb None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:37.787625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-87ff2674-c887-4780-82fe-15a58229ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:37.887691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff2674-c887-4780-82fe-15a58229ecdb None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:37.958011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:37.958649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:37.958929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:37.959205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:37.960870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:38.068998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:38.070351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909273b-d4eb-43e6-b2e5-a95ae759e9f2 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:38.087957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 660/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:41.111533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549db85-56d1-4ec6-97e7-3575fd3dc91c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:41.112102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549db85-56d1-4ec6-97e7-3575fd3dc91c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:41.112102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549db85-56d1-4ec6-97e7-3575fd3dc91c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:41.113458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 658/1318] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:41.118848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974fbd8-4a75-47d9-a304-0ce3aedf88c4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:41.119308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974fbd8-4a75-47d9-a304-0ce3aedf88c4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:41.119444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974fbd8-4a75-47d9-a304-0ce3aedf88c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:41.184112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f974fbd8-4a75-47d9-a304-0ce3aedf88c4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:41.185346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f974fbd8-4a75-47d9-a304-0ce3aedf88c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:41.279020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 661/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:41.333074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14020df-bed1-4756-8528-7668f330b551 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:41.333355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14020df-bed1-4756-8528-7668f330b551 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:41.333628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14020df-bed1-4756-8528-7668f330b551 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:41.334987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 659/1320] 10.222.0.42 () {54 vars in 964 bytes} [Tue May 3 16:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:41.341551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583e0b-9a82-498e-9881-47d344097996 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:41.341841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583e0b-9a82-498e-9881-47d344097996 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:41.342142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583e0b-9a82-498e-9881-47d344097996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:41.415185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ad583e0b-9a82-498e-9881-47d344097996 None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:41.416345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ad583e0b-9a82-498e-9881-47d344097996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:41.490677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 662/1321] 10.222.0.42 () {58 vars in 1061 bytes} [Tue May 3 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:41.500158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14020df-bed1-4756-8528-7668f330b551 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:41.501684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e14020df-bed1-4756-8528-7668f330b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:41.600421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14020df-bed1-4756-8528-7668f330b551 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:41.670927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:41.671520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:41.671802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:41.672074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:41.673712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:41.777831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:41.779301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572c18a-3655-4f2d-926d-034b4ce3ca40 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:41.796375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 660/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:45.493479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66913dc-961b-4dd4-a96f-7ca4b64cde71 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:45.494028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66913dc-961b-4dd4-a96f-7ca4b64cde71 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:45.494028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66913dc-961b-4dd4-a96f-7ca4b64cde71 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:45.495470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 663/1323] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:45.501267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba077-d2b7-40cc-87cb-6d0bd012f8da None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:45.501707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba077-d2b7-40cc-87cb-6d0bd012f8da None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:45.501845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fba077-d2b7-40cc-87cb-6d0bd012f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:45.566346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-50fba077-d2b7-40cc-87cb-6d0bd012f8da None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:45.567578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-50fba077-d2b7-40cc-87cb-6d0bd012f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:45.660766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 661/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:45.696431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66913dc-961b-4dd4-a96f-7ca4b64cde71 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:45.698029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a66913dc-961b-4dd4-a96f-7ca4b64cde71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:45.801545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66913dc-961b-4dd4-a96f-7ca4b64cde71 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:45.874560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:45.875199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:45.875512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:45.875786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:45.877433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:45.984892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:45.986343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a471a0-38a4-4aef-a961-a77b8e8a5174 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:46.004410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 664/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:48.317544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a366a7-dcc6-4587-91b1-5efaccb99fad None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:48.318095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a366a7-dcc6-4587-91b1-5efaccb99fad None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:48.318095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a366a7-dcc6-4587-91b1-5efaccb99fad None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:48.319509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 662/1326] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:48.324606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad69e59-1245-40bd-9947-57e8d3372c34 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:48.326325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad69e59-1245-40bd-9947-57e8d3372c34 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:48.326325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad69e59-1245-40bd-9947-57e8d3372c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:48.391049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-8ad69e59-1245-40bd-9947-57e8d3372c34 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:48.392298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8ad69e59-1245-40bd-9947-57e8d3372c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:48.489120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 665/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:48.526280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a366a7-dcc6-4587-91b1-5efaccb99fad None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:48.527884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f9a366a7-dcc6-4587-91b1-5efaccb99fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:48.633364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a366a7-dcc6-4587-91b1-5efaccb99fad None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:48.704805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:48.705339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:48.705626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:48.705904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:48.707564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:48.813525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:48.814952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fda74-2b95-4440-84f3-1661fcfc57e8 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:48.833441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 663/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:51.140640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7cb5-613c-4e26-9759-6a4f71ddbc5a None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:51.141183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7cb5-613c-4e26-9759-6a4f71ddbc5a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:51.141183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7cb5-613c-4e26-9759-6a4f71ddbc5a None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:51.142579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 666/1329] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:51.147733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ee89-d5a4-4892-afd0-dafa5efba0ef None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:51.148185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ee89-d5a4-4892-afd0-dafa5efba0ef None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:51.148278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995ee89-d5a4-4892-afd0-dafa5efba0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:51.213026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c995ee89-d5a4-4892-afd0-dafa5efba0ef None None] MFA Rules not processed for user `6439f896de0f426b8c65c2ee40200b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:51.214365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c995ee89-d5a4-4892-afd0-dafa5efba0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:51.312672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 664/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:51.349196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e7cb5-613c-4e26-9759-6a4f71ddbc5a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:51.350757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e62e7cb5-613c-4e26-9759-6a4f71ddbc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:51.454885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e7cb5-613c-4e26-9759-6a4f71ddbc5a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:51.528335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:51.529026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:51.529309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:51.529585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:51.531231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:51.638533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:51.640088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9afa0-9806-4188-a101-40baef7ef411 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:51.661235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 667/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:54.361627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011810e-1dc4-4c41-a7a6-b4d17190b5f2 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:54.362190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011810e-1dc4-4c41-a7a6-b4d17190b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:54.362190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011810e-1dc4-4c41-a7a6-b4d17190b5f2 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:54.363554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 665/1332] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:54.368894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e3916-2348-4727-8b3f-a4f4adf10482 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:54.369287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e3916-2348-4727-8b3f-a4f4adf10482 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:54.369458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e3916-2348-4727-8b3f-a4f4adf10482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:54.434703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f95e3916-2348-4727-8b3f-a4f4adf10482 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:54.436087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f95e3916-2348-4727-8b3f-a4f4adf10482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:54.533017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 668/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:19:54.569520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011810e-1dc4-4c41-a7a6-b4d17190b5f2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:54.571058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d011810e-1dc4-4c41-a7a6-b4d17190b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:54.676240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011810e-1dc4-4c41-a7a6-b4d17190b5f2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:54.757656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:54.758326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:54.758614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:54.758888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:54.760625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:54.879366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:54.880841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95405997-164c-4fd5-9c83-ce41b00218aa service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:54.900725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 666/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:19:57.225756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04813f0-63e8-46ea-865b-6a19a81c12d5 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:57.226363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04813f0-63e8-46ea-865b-6a19a81c12d5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:57.226363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04813f0-63e8-46ea-865b-6a19a81c12d5 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:57.227699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 669/1335] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:19:57.232933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040fbd3-2d03-473e-a914-f46493ad04c5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:57.233390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040fbd3-2d03-473e-a914-f46493ad04c5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:57.233494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040fbd3-2d03-473e-a914-f46493ad04c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:57.296912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d040fbd3-2d03-473e-a914-f46493ad04c5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:19:57.298102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d040fbd3-2d03-473e-a914-f46493ad04c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:57.391013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 667/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:19:57.431023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04813f0-63e8-46ea-865b-6a19a81c12d5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:19:57.432606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c04813f0-63e8-46ea-865b-6a19a81c12d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:57.532655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04813f0-63e8-46ea-865b-6a19a81c12d5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:19:57.604673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:19:57.605316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:19:57.605615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:19:57.605971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:19:57.607616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:19:57.713428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:19:57.714880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e162f05-be9f-43bd-810d-660635f28c77 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:19:57.733699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 670/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:00.678746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18effd88-950f-4de9-ae56-03ba8d49eee6 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:00.679385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18effd88-950f-4de9-ae56-03ba8d49eee6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:00.679385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18effd88-950f-4de9-ae56-03ba8d49eee6 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:00.680687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 668/1338] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:00.686515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd775a0-48f6-42d2-a1d4-f086247b1ed4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:00.686997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd775a0-48f6-42d2-a1d4-f086247b1ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:00.687159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd775a0-48f6-42d2-a1d4-f086247b1ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:00.753600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3fd775a0-48f6-42d2-a1d4-f086247b1ed4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:00.754794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3fd775a0-48f6-42d2-a1d4-f086247b1ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:00.857766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 671/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:00.895829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18effd88-950f-4de9-ae56-03ba8d49eee6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:00.898870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-18effd88-950f-4de9-ae56-03ba8d49eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:01.008301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18effd88-950f-4de9-ae56-03ba8d49eee6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:01.012073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:01.012794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:01.013075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:01.013349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:01.015092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:01.112990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:01.114334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b90e2f-a5da-4419-86e0-c1b03148726b service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:01.133132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 669/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:05.676280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d438-7f44-4ccd-bcca-c4195a9bec0b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:05.676810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d438-7f44-4ccd-bcca-c4195a9bec0b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:05.676810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d438-7f44-4ccd-bcca-c4195a9bec0b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:05.678131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 672/1341] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:05.683868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae0d3-ffd0-448f-8f5c-a5de6c04728b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:05.684285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae0d3-ffd0-448f-8f5c-a5de6c04728b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:05.684547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ae0d3-ffd0-448f-8f5c-a5de6c04728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:05.729547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-570ae0d3-ffd0-448f-8f5c-a5de6c04728b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:05.731463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-570ae0d3-ffd0-448f-8f5c-a5de6c04728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:05.812876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 670/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:05.850751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d438-7f44-4ccd-bcca-c4195a9bec0b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:05.852959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3c64d438-7f44-4ccd-bcca-c4195a9bec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:05.866975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d438-7f44-4ccd-bcca-c4195a9bec0b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:05.870997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c8e87-c187-489b-8863-84bab30f55d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:05.871665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c8e87-c187-489b-8863-84bab30f55d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:05.871952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c8e87-c187-489b-8863-84bab30f55d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:05.872231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c8e87-c187-489b-8863-84bab30f55d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:05.881442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c8e87-c187-489b-8863-84bab30f55d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:05.882967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c8e87-c187-489b-8863-84bab30f55d2 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:05.892418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 673/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:09.300126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a0077-88b4-43af-b7b4-ca890f95c5ec None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:09.300703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a0077-88b4-43af-b7b4-ca890f95c5ec None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:09.300823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a0077-88b4-43af-b7b4-ca890f95c5ec None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:09.302200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 671/1344] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:09.307568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fcb4c-c7f9-4c89-b8e1-88628b976bab None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:09.307998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fcb4c-c7f9-4c89-b8e1-88628b976bab None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:09.308230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fcb4c-c7f9-4c89-b8e1-88628b976bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:09.335990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5f1fcb4c-c7f9-4c89-b8e1-88628b976bab None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:09.337171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5f1fcb4c-c7f9-4c89-b8e1-88628b976bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:09.345926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 674/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:09.383455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a0077-88b4-43af-b7b4-ca890f95c5ec None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:09.394739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a0077-88b4-43af-b7b4-ca890f95c5ec None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:09.398346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fdbfc-0364-490e-b94d-eeab491cf705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:09.399015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fdbfc-0364-490e-b94d-eeab491cf705 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:09.403232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fdbfc-0364-490e-b94d-eeab491cf705 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:09.403232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fdbfc-0364-490e-b94d-eeab491cf705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:09.410625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fdbfc-0364-490e-b94d-eeab491cf705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:09.412132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fdbfc-0364-490e-b94d-eeab491cf705 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:09.422318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 672/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:14.101491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90150d-7276-4d8c-a5a0-6057fb5e003c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:14.102033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90150d-7276-4d8c-a5a0-6057fb5e003c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:14.102033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90150d-7276-4d8c-a5a0-6057fb5e003c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:14.103632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 675/1347] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:14.108779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d5774-197a-4622-b5f7-da197dc31ff4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:14.109180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d5774-197a-4622-b5f7-da197dc31ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:14.109458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d5774-197a-4622-b5f7-da197dc31ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:14.128696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e66d5774-197a-4622-b5f7-da197dc31ff4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:14.129889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e66d5774-197a-4622-b5f7-da197dc31ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:14.138823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 673/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:14.177068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90150d-7276-4d8c-a5a0-6057fb5e003c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:14.188149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90150d-7276-4d8c-a5a0-6057fb5e003c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:14.191617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20330c5-3792-43ae-81fa-9e11648f2ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:14.192249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20330c5-3792-43ae-81fa-9e11648f2ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:14.192532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20330c5-3792-43ae-81fa-9e11648f2ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:14.192808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20330c5-3792-43ae-81fa-9e11648f2ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:14.202265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20330c5-3792-43ae-81fa-9e11648f2ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:14.203668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20330c5-3792-43ae-81fa-9e11648f2ee6 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:14.212787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 676/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:19.626136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61840797-87bb-4dea-8131-f56c06c413e8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:19.627158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61840797-87bb-4dea-8131-f56c06c413e8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:19.627698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61840797-87bb-4dea-8131-f56c06c413e8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:19.629593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 674/1350] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:19.634520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2794-af42-4a85-823c-7d973ca68b14 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:19.634941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2794-af42-4a85-823c-7d973ca68b14 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:19.635061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2794-af42-4a85-823c-7d973ca68b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:19.716512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-58dd2794-af42-4a85-823c-7d973ca68b14 None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:19.718054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-58dd2794-af42-4a85-823c-7d973ca68b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:19.810873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 677/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:23.956829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990d8f-63d0-4e16-8b5d-fffc0b7f05f2 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:23.957369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990d8f-63d0-4e16-8b5d-fffc0b7f05f2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:23.957369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990d8f-63d0-4e16-8b5d-fffc0b7f05f2 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:23.958739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 675/1352] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:23.964752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665743-60dc-454e-907f-138a48c6d0df None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:23.965208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665743-60dc-454e-907f-138a48c6d0df None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:23.965520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665743-60dc-454e-907f-138a48c6d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:23.984403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-51665743-60dc-454e-907f-138a48c6d0df None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:23.985599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-51665743-60dc-454e-907f-138a48c6d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:23.994736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 678/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:25.767742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4c43-fcd3-439d-8869-56b784b36244 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:25.768250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4c43-fcd3-439d-8869-56b784b36244 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:25.768250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4c43-fcd3-439d-8869-56b784b36244 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:25.769586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 676/1354] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:25.774470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6326418-d85e-4f70-b2fe-a08854d5eed7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:25.774893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6326418-d85e-4f70-b2fe-a08854d5eed7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:25.775029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6326418-d85e-4f70-b2fe-a08854d5eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:25.793492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b6326418-d85e-4f70-b2fe-a08854d5eed7 None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:25.794666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b6326418-d85e-4f70-b2fe-a08854d5eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:25.803154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 679/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:20:29.593864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11219e-52c7-4253-814c-b33af79dcf9c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:29.594465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11219e-52c7-4253-814c-b33af79dcf9c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:29.594465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11219e-52c7-4253-814c-b33af79dcf9c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:29.599607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 677/1356] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:20:29.601500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47767d-1f8e-42ec-bb72-d5a9f787ae29 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:29.601959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47767d-1f8e-42ec-bb72-d5a9f787ae29 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:29.602313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47767d-1f8e-42ec-bb72-d5a9f787ae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:29.622786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7d47767d-1f8e-42ec-bb72-d5a9f787ae29 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:29.624066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7d47767d-1f8e-42ec-bb72-d5a9f787ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:29.632444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 680/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:29.681813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401243-dec4-4679-b94d-a0183392c8da None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:29.682438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401243-dec4-4679-b94d-a0183392c8da None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:29.682824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d401243-dec4-4679-b94d-a0183392c8da None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:29.684732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 678/1358] 10.222.0.42 () {54 vars in 960 bytes} [Tue May 3 16:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:29.693701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c425774-0668-42be-874d-c2cd088dbd59 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:29.699539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c425774-0668-42be-874d-c2cd088dbd59 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:29.699539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c425774-0668-42be-874d-c2cd088dbd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:29.745460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7c425774-0668-42be-874d-c2cd088dbd59 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:29.746776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7c425774-0668-42be-874d-c2cd088dbd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:29.827972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 681/1359] 10.222.0.42 () {58 vars in 1057 bytes} [Tue May 3 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:29.836175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d401243-dec4-4679-b94d-a0183392c8da None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:29.851371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d401243-dec4-4679-b94d-a0183392c8da None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:29.857433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28eaf8-bc1a-402e-9b7d-ed8079fa29f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:29.858307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28eaf8-bc1a-402e-9b7d-ed8079fa29f1 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:29.858660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28eaf8-bc1a-402e-9b7d-ed8079fa29f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:29.859034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28eaf8-bc1a-402e-9b7d-ed8079fa29f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:29.867185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28eaf8-bc1a-402e-9b7d-ed8079fa29f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:29.869129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28eaf8-bc1a-402e-9b7d-ed8079fa29f1 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:29.878515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 679/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:32.350823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69defd-1559-4aae-8fe8-0c96e5df39bd None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:32.351427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69defd-1559-4aae-8fe8-0c96e5df39bd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:32.351427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69defd-1559-4aae-8fe8-0c96e5df39bd None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:32.352929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 682/1361] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:32.358082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb737a-2785-4863-87a3-12bf9de5de6f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:32.358527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb737a-2785-4863-87a3-12bf9de5de6f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:32.358622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb737a-2785-4863-87a3-12bf9de5de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:32.376493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-63eb737a-2785-4863-87a3-12bf9de5de6f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:32.377702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-63eb737a-2785-4863-87a3-12bf9de5de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:32.386094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 680/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:32.429611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69defd-1559-4aae-8fe8-0c96e5df39bd None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:32.444667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69defd-1559-4aae-8fe8-0c96e5df39bd None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:32.451080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776383e6-09e1-470d-ad71-5f18f9e929ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:32.451835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776383e6-09e1-470d-ad71-5f18f9e929ac service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:32.452179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776383e6-09e1-470d-ad71-5f18f9e929ac service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:32.452527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776383e6-09e1-470d-ad71-5f18f9e929ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:32.460985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776383e6-09e1-470d-ad71-5f18f9e929ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:32.462638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776383e6-09e1-470d-ad71-5f18f9e929ac service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:32.473732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 683/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:35.212011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609e01-df27-4e07-945b-8f1df7e382a8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:35.212531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609e01-df27-4e07-945b-8f1df7e382a8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:35.212531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609e01-df27-4e07-945b-8f1df7e382a8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:35.214494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 681/1364] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:35.219994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac00d7-6604-4dee-bdde-1fef4c5572fb None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:35.220432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac00d7-6604-4dee-bdde-1fef4c5572fb None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:35.220719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac00d7-6604-4dee-bdde-1fef4c5572fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:35.238863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d1ac00d7-6604-4dee-bdde-1fef4c5572fb None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:35.240106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d1ac00d7-6604-4dee-bdde-1fef4c5572fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:35.248356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 684/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:35.294917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb6d9-860a-4d6d-bcf9-f5c1b38ee69f None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:35.295208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb6d9-860a-4d6d-bcf9-f5c1b38ee69f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:35.295526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb6d9-860a-4d6d-bcf9-f5c1b38ee69f None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:35.296894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 682/1366] 10.222.0.42 () {54 vars in 960 bytes} [Tue May 3 16:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:35.302112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e996-5c76-4261-97dc-520d7bcc42a2 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:35.302409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e996-5c76-4261-97dc-520d7bcc42a2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:35.302694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e996-5c76-4261-97dc-520d7bcc42a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:35.320674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-cec5e996-5c76-4261-97dc-520d7bcc42a2 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:35.321849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cec5e996-5c76-4261-97dc-520d7bcc42a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:35.331836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 685/1367] 10.222.0.42 () {58 vars in 1057 bytes} [Tue May 3 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:35.340593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb6d9-860a-4d6d-bcf9-f5c1b38ee69f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:35.358325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb6d9-860a-4d6d-bcf9-f5c1b38ee69f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:35.360774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fade5-61f4-4f4e-8d3f-382c46be38b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:35.361412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fade5-61f4-4f4e-8d3f-382c46be38b5 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:35.362401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fade5-61f4-4f4e-8d3f-382c46be38b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:35.362688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fade5-61f4-4f4e-8d3f-382c46be38b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:35.371570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fade5-61f4-4f4e-8d3f-382c46be38b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:35.373157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fade5-61f4-4f4e-8d3f-382c46be38b5 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:35.383063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 683/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:37.890136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b9b99-aa22-49f1-be3d-b495a3fadd37 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:37.890727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b9b99-aa22-49f1-be3d-b495a3fadd37 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:37.890727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b9b99-aa22-49f1-be3d-b495a3fadd37 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:37.892158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 686/1369] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:37.898090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:37.899074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:37.899578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:37.904128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff6c8-5e1e-4025-8d66-a2b6c636b459 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:37.904411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff6c8-5e1e-4025-8d66-a2b6c636b459 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:37.904884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff6c8-5e1e-4025-8d66-a2b6c636b459 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:37.906530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 687/1370] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:20:37.912202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881c0a-ad68-433e-96a2-1ae52255cb70 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:37.912493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881c0a-ad68-433e-96a2-1ae52255cb70 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:37.912959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881c0a-ad68-433e-96a2-1ae52255cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:37.922398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:37.924319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:37.932319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0c881c0a-ad68-433e-96a2-1ae52255cb70 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:37.933460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 684/1371] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:37.934632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0c881c0a-ad68-433e-96a2-1ae52255cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:37.944105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 688/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:20:37.989788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:38.002933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708f9c-3745-49f1-b931-2bea265a2676 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:38.008597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a607a15-ff59-48a0-81f3-c0a7ce41dce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:38.009326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a607a15-ff59-48a0-81f3-c0a7ce41dce8 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:38.009687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a607a15-ff59-48a0-81f3-c0a7ce41dce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:38.010071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a607a15-ff59-48a0-81f3-c0a7ce41dce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:38.018716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a607a15-ff59-48a0-81f3-c0a7ce41dce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:38.020321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a607a15-ff59-48a0-81f3-c0a7ce41dce8 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:38.031169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 685/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:38.237971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fbaf0-9413-469a-9340-9bca125b8d1f None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:38.238264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fbaf0-9413-469a-9340-9bca125b8d1f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:38.238751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fbaf0-9413-469a-9340-9bca125b8d1f None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:38.240255 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 689/1374] 10.222.0.42 () {54 vars in 963 bytes} [Tue May 3 16:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:38.245990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc74c6d-698f-413e-b323-6cc690c75ce6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:38.246282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc74c6d-698f-413e-b323-6cc690c75ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:38.246563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc74c6d-698f-413e-b323-6cc690c75ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:38.305239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7cc74c6d-698f-413e-b323-6cc690c75ce6 None None] MFA Rules not processed for user `6d24cf5fddb64b1096184a842975ae3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:38.306534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7cc74c6d-698f-413e-b323-6cc690c75ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:38.374617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 686/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Tue May 3 16:20:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:38.382662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fbaf0-9413-469a-9340-9bca125b8d1f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:38.395145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fbaf0-9413-469a-9340-9bca125b8d1f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:38.398813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736434-57ba-4ac2-9abd-f775afd5facd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:38.399542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736434-57ba-4ac2-9abd-f775afd5facd service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:38.399830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736434-57ba-4ac2-9abd-f775afd5facd service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:38.400107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736434-57ba-4ac2-9abd-f775afd5facd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:38.411018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736434-57ba-4ac2-9abd-f775afd5facd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:38.412493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736434-57ba-4ac2-9abd-f775afd5facd service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:38.423756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 690/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:20:40.486218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a810f-cd5b-445b-a483-8c1a13567b56 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:40.486666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a810f-cd5b-445b-a483-8c1a13567b56 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:40.486666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a810f-cd5b-445b-a483-8c1a13567b56 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:40.487965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 687/1377] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:40.493194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d10dac-01df-40dc-ab3b-c037689d71c7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:40.493891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d10dac-01df-40dc-ab3b-c037689d71c7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:40.494547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d10dac-01df-40dc-ab3b-c037689d71c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:40.516622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-78d10dac-01df-40dc-ab3b-c037689d71c7 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:40.517831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-78d10dac-01df-40dc-ab3b-c037689d71c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:40.527015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 691/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:40.571010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a810f-cd5b-445b-a483-8c1a13567b56 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:40.586733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a810f-cd5b-445b-a483-8c1a13567b56 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:40.593380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6fd8-0830-4351-88e1-0afc396a4282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:40.594104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6fd8-0830-4351-88e1-0afc396a4282 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:40.594394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6fd8-0830-4351-88e1-0afc396a4282 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:40.594673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6fd8-0830-4351-88e1-0afc396a4282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:40.604061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c6fd8-0830-4351-88e1-0afc396a4282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:40.605714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c6fd8-0830-4351-88e1-0afc396a4282 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:40.615553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 688/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:43.069822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2790d4-37d8-45d8-8a54-f1bfefad9068 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:43.070982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2790d4-37d8-45d8-8a54-f1bfefad9068 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:43.071633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2790d4-37d8-45d8-8a54-f1bfefad9068 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:43.074285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 692/1380] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:43.079055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910d42f-70ba-476c-8409-b9727bf25666 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:43.079933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910d42f-70ba-476c-8409-b9727bf25666 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:43.080426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910d42f-70ba-476c-8409-b9727bf25666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:43.098902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1910d42f-70ba-476c-8409-b9727bf25666 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:43.100098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1910d42f-70ba-476c-8409-b9727bf25666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:43.108241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 689/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:43.153269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2790d4-37d8-45d8-8a54-f1bfefad9068 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:43.168405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2790d4-37d8-45d8-8a54-f1bfefad9068 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:43.174050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9086668-ae01-40e8-994a-55dfff1d440a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:43.174804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9086668-ae01-40e8-994a-55dfff1d440a service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:43.175178 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9086668-ae01-40e8-994a-55dfff1d440a service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:43.175683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9086668-ae01-40e8-994a-55dfff1d440a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:43.184917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9086668-ae01-40e8-994a-55dfff1d440a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:43.186486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9086668-ae01-40e8-994a-55dfff1d440a service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:43.195734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 693/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:45.623099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2bc45-5e5e-480a-85cc-e52152195eb3 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:45.623725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2bc45-5e5e-480a-85cc-e52152195eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:45.623858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2bc45-5e5e-480a-85cc-e52152195eb3 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:45.625205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 690/1383] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:45.630665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c10897-d64a-49f2-9294-8017b5f25c6e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:45.631084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c10897-d64a-49f2-9294-8017b5f25c6e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:45.631593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c10897-d64a-49f2-9294-8017b5f25c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:45.649385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-90c10897-d64a-49f2-9294-8017b5f25c6e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:45.651119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-90c10897-d64a-49f2-9294-8017b5f25c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:45.659292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 694/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:45.700231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2bc45-5e5e-480a-85cc-e52152195eb3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:45.715701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2bc45-5e5e-480a-85cc-e52152195eb3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:45.721209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d98485-cd19-4558-b042-0b3d3d3f6e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:45.721917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d98485-cd19-4558-b042-0b3d3d3f6e9f service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:45.722264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d98485-cd19-4558-b042-0b3d3d3f6e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:45.722725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d98485-cd19-4558-b042-0b3d3d3f6e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:45.731058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d98485-cd19-4558-b042-0b3d3d3f6e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:45.732672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d98485-cd19-4558-b042-0b3d3d3f6e9f service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:45.742240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 691/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:48.008612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc716-d9dd-452c-ac80-04c5ed6dcb7e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:48.009161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc716-d9dd-452c-ac80-04c5ed6dcb7e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:48.009926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc716-d9dd-452c-ac80-04c5ed6dcb7e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:48.012505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 695/1386] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:48.017630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87874083-6fdf-4c06-ac6d-b023d446ba2b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:48.018223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87874083-6fdf-4c06-ac6d-b023d446ba2b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:48.018223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87874083-6fdf-4c06-ac6d-b023d446ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:48.035821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-87874083-6fdf-4c06-ac6d-b023d446ba2b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:48.037018 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-87874083-6fdf-4c06-ac6d-b023d446ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:48.046059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 692/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:48.091671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc716-d9dd-452c-ac80-04c5ed6dcb7e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:48.106754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc716-d9dd-452c-ac80-04c5ed6dcb7e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:48.112345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49eb4-125a-4ef3-b861-63f6a4afd91e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:48.113001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49eb4-125a-4ef3-b861-63f6a4afd91e service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:48.113326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49eb4-125a-4ef3-b861-63f6a4afd91e service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:48.113545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49eb4-125a-4ef3-b861-63f6a4afd91e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:48.122994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a49eb4-125a-4ef3-b861-63f6a4afd91e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:48.124742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a49eb4-125a-4ef3-b861-63f6a4afd91e service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:48.134156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 696/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:50.990455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6564-33aa-44ca-912a-ab8b0f776999 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:50.991031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6564-33aa-44ca-912a-ab8b0f776999 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:50.991031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6564-33aa-44ca-912a-ab8b0f776999 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:50.992404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 693/1389] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:50.997963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbd0d2-b0f9-41c5-81bd-30e7ad375251 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:50.998431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbd0d2-b0f9-41c5-81bd-30e7ad375251 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:50.998539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbd0d2-b0f9-41c5-81bd-30e7ad375251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:51.016574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-06bbd0d2-b0f9-41c5-81bd-30e7ad375251 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:51.017773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-06bbd0d2-b0f9-41c5-81bd-30e7ad375251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:51.027206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 697/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:51.076603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6564-33aa-44ca-912a-ab8b0f776999 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:51.095498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6564-33aa-44ca-912a-ab8b0f776999 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:51.102313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640acb86-5360-4fdb-b4d2-e7b49c0466f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:51.103200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640acb86-5360-4fdb-b4d2-e7b49c0466f8 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:51.103931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640acb86-5360-4fdb-b4d2-e7b49c0466f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:51.104512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640acb86-5360-4fdb-b4d2-e7b49c0466f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:51.114664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640acb86-5360-4fdb-b4d2-e7b49c0466f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:51.116325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640acb86-5360-4fdb-b4d2-e7b49c0466f8 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:51.126621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 694/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:53.621654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bc05c-3740-43ba-8261-ea1dd20d32e9 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:53.622297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bc05c-3740-43ba-8261-ea1dd20d32e9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:53.622297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bc05c-3740-43ba-8261-ea1dd20d32e9 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:53.623898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 698/1392] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:53.629023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb78b33-c8f5-45c8-b72c-3d27af1ff28d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:53.629453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb78b33-c8f5-45c8-b72c-3d27af1ff28d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:53.629710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb78b33-c8f5-45c8-b72c-3d27af1ff28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:53.647316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-eeb78b33-c8f5-45c8-b72c-3d27af1ff28d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:53.654077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-eeb78b33-c8f5-45c8-b72c-3d27af1ff28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:53.657784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 695/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:53.702117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bc05c-3740-43ba-8261-ea1dd20d32e9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:53.717829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bc05c-3740-43ba-8261-ea1dd20d32e9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:53.723061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce5e08-5e78-41c8-8a5a-2672a09b7146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:53.723738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5e08-5e78-41c8-8a5a-2672a09b7146 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:53.724023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5e08-5e78-41c8-8a5a-2672a09b7146 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:53.724302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5e08-5e78-41c8-8a5a-2672a09b7146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:53.734091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5e08-5e78-41c8-8a5a-2672a09b7146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:53.735687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5e08-5e78-41c8-8a5a-2672a09b7146 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:53.746933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 699/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:54.313806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532491-6ad3-4d35-bed7-f707fc68850f None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:54.314094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532491-6ad3-4d35-bed7-f707fc68850f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:54.314372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532491-6ad3-4d35-bed7-f707fc68850f None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:54.315776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 696/1395] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:54.320989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357d1a-7610-40fe-a704-7e7028d8c423 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:54.321336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357d1a-7610-40fe-a704-7e7028d8c423 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:54.322685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357d1a-7610-40fe-a704-7e7028d8c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:54.340082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7e357d1a-7610-40fe-a704-7e7028d8c423 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:54.341257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7e357d1a-7610-40fe-a704-7e7028d8c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:54.349438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 700/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:54.406056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49990f-4377-40a4-b3b9-a308cf2d5815 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:54.406353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49990f-4377-40a4-b3b9-a308cf2d5815 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:54.412558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49990f-4377-40a4-b3b9-a308cf2d5815 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:54.412558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 697/1397] 10.222.0.42 () {54 vars in 962 bytes} [Tue May 3 16:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:54.412868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975f1dd-f00b-4a19-ae4a-36cc9b8f39cb None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:54.413156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975f1dd-f00b-4a19-ae4a-36cc9b8f39cb None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:54.413430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975f1dd-f00b-4a19-ae4a-36cc9b8f39cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:54.460690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1975f1dd-f00b-4a19-ae4a-36cc9b8f39cb None None] MFA Rules not processed for user `0545d7ffc7b84827a5f64629b0e447f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:54.461904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1975f1dd-f00b-4a19-ae4a-36cc9b8f39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:54.520690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 701/1398] 10.222.0.42 () {58 vars in 1059 bytes} [Tue May 3 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:54.528689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49990f-4377-40a4-b3b9-a308cf2d5815 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:54.538946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49990f-4377-40a4-b3b9-a308cf2d5815 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:54.543194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbb0f6-6d96-47c3-a653-c473ce3fdf07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:54.543853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbb0f6-6d96-47c3-a653-c473ce3fdf07 service glance] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:54.544136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbb0f6-6d96-47c3-a653-c473ce3fdf07 service glance] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:54.544412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbb0f6-6d96-47c3-a653-c473ce3fdf07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:54.553224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbb0f6-6d96-47c3-a653-c473ce3fdf07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:54.554963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbb0f6-6d96-47c3-a653-c473ce3fdf07 service glance] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:54.564416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 698/1399] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:55.138139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaaf2b-dcd3-4136-be2c-ab30261b9a9a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:55.142096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaaf2b-dcd3-4136-be2c-ab30261b9a9a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:55.142096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaaf2b-dcd3-4136-be2c-ab30261b9a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:55.186044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-6aeaaf2b-dcd3-4136-be2c-ab30261b9a9a None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:55.187218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6aeaaf2b-dcd3-4136-be2c-ab30261b9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:55.247773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 702/1400] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:20:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:55.292598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b8d93-d69d-4b20-9467-2cd3ede252a8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:55.293128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b8d93-d69d-4b20-9467-2cd3ede252a8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:55.293128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b8d93-d69d-4b20-9467-2cd3ede252a8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:55.294559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 699/1401] 10.222.0.42 () {54 vars in 942 bytes} [Tue May 3 16:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:55.300758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287a46-49e2-4f5c-805f-0576ca1b8bc6 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:55.301047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287a46-49e2-4f5c-805f-0576ca1b8bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:55.301464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0287a46-49e2-4f5c-805f-0576ca1b8bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:55.350716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c0287a46-49e2-4f5c-805f-0576ca1b8bc6 None None] MFA Rules not processed for user `9ccd3c2454f94e998769076fbe20eb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:55.352036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c0287a46-49e2-4f5c-805f-0576ca1b8bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:55.427410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 703/1402] 10.222.0.42 () {58 vars in 1039 bytes} [Tue May 3 16:20:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:55.433855 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b8d93-d69d-4b20-9467-2cd3ede252a8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:55.447642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b8d93-d69d-4b20-9467-2cd3ede252a8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:55.452984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b5090-ecdd-4bc2-98ee-207e6f52b928 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:55.453653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5090-ecdd-4bc2-98ee-207e6f52b928 service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:55.453932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5090-ecdd-4bc2-98ee-207e6f52b928 service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:55.454204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b5090-ecdd-4bc2-98ee-207e6f52b928 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:55.462541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b5090-ecdd-4bc2-98ee-207e6f52b928 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:55.464262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b5090-ecdd-4bc2-98ee-207e6f52b928 service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:55.472239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 700/1403] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:20:56.206931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d2029-4cd6-40f0-b2a6-ee6b44adc758 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:56.207483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d2029-4cd6-40f0-b2a6-ee6b44adc758 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:56.207695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d2029-4cd6-40f0-b2a6-ee6b44adc758 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:56.209167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 704/1404] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:56.214907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39945-a281-4676-bbdc-58d15ddd18e3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:56.215206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39945-a281-4676-bbdc-58d15ddd18e3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:56.215521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39945-a281-4676-bbdc-58d15ddd18e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:56.233516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-54a39945-a281-4676-bbdc-58d15ddd18e3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:56.234793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-54a39945-a281-4676-bbdc-58d15ddd18e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:56.244509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 701/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:56.288804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d2029-4cd6-40f0-b2a6-ee6b44adc758 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:56.304385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d2029-4cd6-40f0-b2a6-ee6b44adc758 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:56.310655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b72cc-4120-4be2-890a-d95c655ffff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:56.311358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b72cc-4120-4be2-890a-d95c655ffff4 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:56.311753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b72cc-4120-4be2-890a-d95c655ffff4 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:56.312194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b72cc-4120-4be2-890a-d95c655ffff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:56.322860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b72cc-4120-4be2-890a-d95c655ffff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:56.324487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b72cc-4120-4be2-890a-d95c655ffff4 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:56.335030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 705/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:20:58.865920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e9c8e-6867-4f1a-b3f3-3ac37182a33c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:58.866521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e9c8e-6867-4f1a-b3f3-3ac37182a33c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:58.866521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e9c8e-6867-4f1a-b3f3-3ac37182a33c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:58.868219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 702/1407] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:20:58.873402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07315c0-d0d3-4eff-9d50-29459eac692d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:58.873810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07315c0-d0d3-4eff-9d50-29459eac692d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:58.874002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07315c0-d0d3-4eff-9d50-29459eac692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:58.895044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c07315c0-d0d3-4eff-9d50-29459eac692d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:20:58.896391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c07315c0-d0d3-4eff-9d50-29459eac692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:20:58.905351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 706/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:20:58.951219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e9c8e-6867-4f1a-b3f3-3ac37182a33c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:20:58.968595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e9c8e-6867-4f1a-b3f3-3ac37182a33c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:20:58.974268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9f8b-6802-45e0-91d6-3e8843a0f065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:20:58.974914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9f8b-6802-45e0-91d6-3e8843a0f065 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:20:58.975202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9f8b-6802-45e0-91d6-3e8843a0f065 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:20:58.975516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9f8b-6802-45e0-91d6-3e8843a0f065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:20:58.984620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9f8b-6802-45e0-91d6-3e8843a0f065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:20:58.986182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9f8b-6802-45e0-91d6-3e8843a0f065 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:20:59.000674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 703/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:20.194264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e127a-95aa-4b9e-8844-6f7779163260 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:20.194911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e127a-95aa-4b9e-8844-6f7779163260 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:20.194911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e127a-95aa-4b9e-8844-6f7779163260 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:20.196246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 707/1410] 10.222.0.42 () {54 vars in 918 bytes} [Tue May 3 16:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:20.201946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60923e-79a9-489b-bde5-33103e06ba46 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:20.202403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60923e-79a9-489b-bde5-33103e06ba46 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:20.202535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60923e-79a9-489b-bde5-33103e06ba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:20.223655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8e60923e-79a9-489b-bde5-33103e06ba46 None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:20.224854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8e60923e-79a9-489b-bde5-33103e06ba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:20.233601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 704/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Tue May 3 16:21:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:20.248784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5ce4c-1e51-43b6-b1e8-db6d9e8ae2f8 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:20.249075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5ce4c-1e51-43b6-b1e8-db6d9e8ae2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:20.249350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5ce4c-1e51-43b6-b1e8-db6d9e8ae2f8 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:20.250699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 708/1412] 10.222.0.42 () {54 vars in 918 bytes} [Tue May 3 16:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:20.255082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359d1a-f524-43d8-b743-751b5e9de0b2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:20.255407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359d1a-f524-43d8-b743-751b5e9de0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:20.255685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359d1a-f524-43d8-b743-751b5e9de0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:20.274434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d1359d1a-f524-43d8-b743-751b5e9de0b2 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:20.275652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d1359d1a-f524-43d8-b743-751b5e9de0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:20.284699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 705/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Tue May 3 16:21:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:22.987504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530e50-6ff4-4ccc-b399-4d7cba3b4965 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:22.988079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530e50-6ff4-4ccc-b399-4d7cba3b4965 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:22.988079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530e50-6ff4-4ccc-b399-4d7cba3b4965 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:22.989436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:22.995350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b812525-cf8d-46af-8b0f-5801cd68216c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:22.995801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b812525-cf8d-46af-8b0f-5801cd68216c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:22.995900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b812525-cf8d-46af-8b0f-5801cd68216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:23.015479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9b812525-cf8d-46af-8b0f-5801cd68216c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:23.016659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9b812525-cf8d-46af-8b0f-5801cd68216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:23.024458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:23.065163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530e50-6ff4-4ccc-b399-4d7cba3b4965 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:23.079945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530e50-6ff4-4ccc-b399-4d7cba3b4965 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:23.085177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972c79-fa01-413e-9c37-623e57172d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:23.086096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972c79-fa01-413e-9c37-623e57172d9e service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:23.086439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972c79-fa01-413e-9c37-623e57172d9e service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:23.086713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972c79-fa01-413e-9c37-623e57172d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:23.094814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972c79-fa01-413e-9c37-623e57172d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:23.096402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972c79-fa01-413e-9c37-623e57172d9e service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:23.105655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 710/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:24.415215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef1b0-e952-41ff-98b4-4970533a7807 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:24.415848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef1b0-e952-41ff-98b4-4970533a7807 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:24.423407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bef1b0-e952-41ff-98b4-4970533a7807 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:24.423407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:24.423612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08061d-31eb-4b1d-914b-aa9e58cd8807 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:24.423612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08061d-31eb-4b1d-914b-aa9e58cd8807 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:24.423612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08061d-31eb-4b1d-914b-aa9e58cd8807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:24.441404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ad08061d-31eb-4b1d-914b-aa9e58cd8807 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:24.442606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ad08061d-31eb-4b1d-914b-aa9e58cd8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:24.452595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:24.629117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bef1b0-e952-41ff-98b4-4970533a7807 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:24.645565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bef1b0-e952-41ff-98b4-4970533a7807 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:24.651914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd768ff-b969-4579-ad57-042f86ae9786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:24.652554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd768ff-b969-4579-ad57-042f86ae9786 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:24.652836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd768ff-b969-4579-ad57-042f86ae9786 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:24.653112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd768ff-b969-4579-ad57-042f86ae9786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:24.662448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd768ff-b969-4579-ad57-042f86ae9786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:24.664644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd768ff-b969-4579-ad57-042f86ae9786 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:24.674438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 708/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:25.968733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcc16-3144-4248-b975-2c344e7b9a4d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:25.969329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcc16-3144-4248-b975-2c344e7b9a4d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:25.969329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcc16-3144-4248-b975-2c344e7b9a4d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:25.970747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:25.975897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e848-b010-4eb5-b676-76b8136a16f4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:25.976418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e848-b010-4eb5-b676-76b8136a16f4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:25.976530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00e848-b010-4eb5-b676-76b8136a16f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:25.994554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ca00e848-b010-4eb5-b676-76b8136a16f4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:25.995755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ca00e848-b010-4eb5-b676-76b8136a16f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:26.003314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:26.153260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcc16-3144-4248-b975-2c344e7b9a4d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:26.168406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcc16-3144-4248-b975-2c344e7b9a4d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:26.173602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b527d-bac2-4db1-a511-c7d698595c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:26.174231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b527d-bac2-4db1-a511-c7d698595c22 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:26.174512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b527d-bac2-4db1-a511-c7d698595c22 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:26.174783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b527d-bac2-4db1-a511-c7d698595c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:26.182990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b527d-bac2-4db1-a511-c7d698595c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:26.184594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b527d-bac2-4db1-a511-c7d698595c22 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:26.193749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 713/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:27.425084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc70dfc-1013-4004-bf4d-29b26af24ef8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:27.425667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc70dfc-1013-4004-bf4d-29b26af24ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:27.425667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc70dfc-1013-4004-bf4d-29b26af24ef8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:27.427019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:27.432375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1b5e-2564-41dd-927f-3a543e96c0dc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:27.432799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1b5e-2564-41dd-927f-3a543e96c0dc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:27.432921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1b5e-2564-41dd-927f-3a543e96c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:27.451370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b85f1b5e-2564-41dd-927f-3a543e96c0dc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:27.452597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b85f1b5e-2564-41dd-927f-3a543e96c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:27.460455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:21:27.615441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc70dfc-1013-4004-bf4d-29b26af24ef8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:27.630240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc70dfc-1013-4004-bf4d-29b26af24ef8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:27.636444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c357f89-03dd-40ef-bcbd-89f5a0483168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:27.637071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357f89-03dd-40ef-bcbd-89f5a0483168 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:27.637354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357f89-03dd-40ef-bcbd-89f5a0483168 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:27.637633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357f89-03dd-40ef-bcbd-89f5a0483168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:27.645557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c357f89-03dd-40ef-bcbd-89f5a0483168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:27.647158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c357f89-03dd-40ef-bcbd-89f5a0483168 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:27.656272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 711/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:28.904446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100173c3-5494-43fa-92d5-a4b052ac935b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:28.905015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100173c3-5494-43fa-92d5-a4b052ac935b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:28.905015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100173c3-5494-43fa-92d5-a4b052ac935b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:28.906355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:28.911164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2850-36bb-431f-8816-2defa33a1b90 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:28.911609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2850-36bb-431f-8816-2defa33a1b90 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:28.911752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2850-36bb-431f-8816-2defa33a1b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:28.929842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-12fc2850-36bb-431f-8816-2defa33a1b90 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:28.931015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-12fc2850-36bb-431f-8816-2defa33a1b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:28.938590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:29.084661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100173c3-5494-43fa-92d5-a4b052ac935b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:29.099127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100173c3-5494-43fa-92d5-a4b052ac935b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:29.105188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b778c-4867-48c2-8b2f-a01409baf9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:29.105824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b778c-4867-48c2-8b2f-a01409baf9a8 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:29.106106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b778c-4867-48c2-8b2f-a01409baf9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:29.106380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b778c-4867-48c2-8b2f-a01409baf9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:29.114550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b778c-4867-48c2-8b2f-a01409baf9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:29.116991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b778c-4867-48c2-8b2f-a01409baf9a8 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:29.126450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 716/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:30.359627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942c65-396c-4cf1-924e-18eb914f2c2f None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:30.360170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942c65-396c-4cf1-924e-18eb914f2c2f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:30.360170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942c65-396c-4cf1-924e-18eb914f2c2f None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:30.361557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:30.366958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a10852-8bb8-4954-9a92-6d5792f64990 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:30.366958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a10852-8bb8-4954-9a92-6d5792f64990 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:30.367552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a10852-8bb8-4954-9a92-6d5792f64990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:30.384994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-12a10852-8bb8-4954-9a92-6d5792f64990 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:30.386159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-12a10852-8bb8-4954-9a92-6d5792f64990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:30.393785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:30.546493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942c65-396c-4cf1-924e-18eb914f2c2f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:30.561071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942c65-396c-4cf1-924e-18eb914f2c2f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:30.566560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f496-59de-4622-bcc1-c09b0c9e4e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:30.567196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f496-59de-4622-bcc1-c09b0c9e4e84 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:30.567511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f496-59de-4622-bcc1-c09b0c9e4e84 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:30.567786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f496-59de-4622-bcc1-c09b0c9e4e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:30.576917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f496-59de-4622-bcc1-c09b0c9e4e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:30.578491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f496-59de-4622-bcc1-c09b0c9e4e84 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:30.588309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 714/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:31.817127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e66b-fe51-4a0f-92d7-34b8428b3e2b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:31.817682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e66b-fe51-4a0f-92d7-34b8428b3e2b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:31.817946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e66b-fe51-4a0f-92d7-34b8428b3e2b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:31.819938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:31.824837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c0607-a896-45d9-96f5-f034a6d1aa0e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:31.825267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c0607-a896-45d9-96f5-f034a6d1aa0e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:31.825371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c0607-a896-45d9-96f5-f034a6d1aa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:31.843906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-db6c0607-a896-45d9-96f5-f034a6d1aa0e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:31.845075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-db6c0607-a896-45d9-96f5-f034a6d1aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:31.852825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:32.005116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e66b-fe51-4a0f-92d7-34b8428b3e2b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:32.019232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e66b-fe51-4a0f-92d7-34b8428b3e2b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:32.025568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42894-dbae-4d4c-8c8c-4b905fea48db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:32.026203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42894-dbae-4d4c-8c8c-4b905fea48db service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:32.026488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42894-dbae-4d4c-8c8c-4b905fea48db service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:32.026765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42894-dbae-4d4c-8c8c-4b905fea48db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:32.034792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42894-dbae-4d4c-8c8c-4b905fea48db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:32.036432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42894-dbae-4d4c-8c8c-4b905fea48db service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:32.046609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 719/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:33.312139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111c7d-5642-4476-8cff-948210b0c9be None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:33.312725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111c7d-5642-4476-8cff-948210b0c9be None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:33.312725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111c7d-5642-4476-8cff-948210b0c9be None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:33.314082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:33.318848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6c944-75f5-4941-aedb-699eaa242a55 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:33.319277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6c944-75f5-4941-aedb-699eaa242a55 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:33.319982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6c944-75f5-4941-aedb-699eaa242a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:33.338284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-aac6c944-75f5-4941-aedb-699eaa242a55 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:33.339495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-aac6c944-75f5-4941-aedb-699eaa242a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:33.347223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:33.499622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a111c7d-5642-4476-8cff-948210b0c9be None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:33.515077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a111c7d-5642-4476-8cff-948210b0c9be None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:33.520386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ec67f-70f4-4282-bc31-457cdafd7caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:33.521022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec67f-70f4-4282-bc31-457cdafd7caa service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:33.521308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec67f-70f4-4282-bc31-457cdafd7caa service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:33.521584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec67f-70f4-4282-bc31-457cdafd7caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:33.529953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ec67f-70f4-4282-bc31-457cdafd7caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:33.531547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ec67f-70f4-4282-bc31-457cdafd7caa service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:33.541098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 717/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:34.763805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf34e4-c668-461b-8fb6-bc510e507e9a None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:34.763805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf34e4-c668-461b-8fb6-bc510e507e9a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:34.764297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf34e4-c668-461b-8fb6-bc510e507e9a None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:34.765485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:34.770512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0a98-8258-4641-aa1a-41d45ece9812 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:34.770938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0a98-8258-4641-aa1a-41d45ece9812 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:34.771076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0a98-8258-4641-aa1a-41d45ece9812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:34.789414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-39dd0a98-8258-4641-aa1a-41d45ece9812 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:34.790606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-39dd0a98-8258-4641-aa1a-41d45ece9812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:34.798353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:34.947338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf34e4-c668-461b-8fb6-bc510e507e9a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:34.961693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf34e4-c668-461b-8fb6-bc510e507e9a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:34.967025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df62c1-b269-4160-9a20-14056b03b510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:34.967687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df62c1-b269-4160-9a20-14056b03b510 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:34.967971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df62c1-b269-4160-9a20-14056b03b510 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:34.968244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df62c1-b269-4160-9a20-14056b03b510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:34.976162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df62c1-b269-4160-9a20-14056b03b510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:34.977734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df62c1-b269-4160-9a20-14056b03b510 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:34.986923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 722/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:37.102080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e00a9-66e9-4f9b-ba1e-134ed31ab10d None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:37.102690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e00a9-66e9-4f9b-ba1e-134ed31ab10d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:37.102690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e00a9-66e9-4f9b-ba1e-134ed31ab10d None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:37.104031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:21:37.109143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32868ae-e026-44ee-9a46-8e026e1d26fd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:37.109553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32868ae-e026-44ee-9a46-8e026e1d26fd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:37.109706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32868ae-e026-44ee-9a46-8e026e1d26fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:37.127225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f32868ae-e026-44ee-9a46-8e026e1d26fd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:37.128432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f32868ae-e026-44ee-9a46-8e026e1d26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:37.136759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:37.174893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e00a9-66e9-4f9b-ba1e-134ed31ab10d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:37.186453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e00a9-66e9-4f9b-ba1e-134ed31ab10d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:37.189938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47c49d-c3d2-4ab1-8cbd-5e25237b5e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:37.190565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47c49d-c3d2-4ab1-8cbd-5e25237b5e92 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:37.190847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47c49d-c3d2-4ab1-8cbd-5e25237b5e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:37.191125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47c49d-c3d2-4ab1-8cbd-5e25237b5e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:37.200899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47c49d-c3d2-4ab1-8cbd-5e25237b5e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:37.202307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47c49d-c3d2-4ab1-8cbd-5e25237b5e92 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:37.211829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 720/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:39.584474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394426-452e-425e-a832-341edc22beb3 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:39.585088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394426-452e-425e-a832-341edc22beb3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:39.585224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394426-452e-425e-a832-341edc22beb3 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:39.586631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:39.592066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605aecb-d356-4337-81ff-f60d5960e888 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:39.592527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605aecb-d356-4337-81ff-f60d5960e888 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:39.592630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605aecb-d356-4337-81ff-f60d5960e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:39.609823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0605aecb-d356-4337-81ff-f60d5960e888 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:39.610992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0605aecb-d356-4337-81ff-f60d5960e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:39.619495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:39.656750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e394426-452e-425e-a832-341edc22beb3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:39.667424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e394426-452e-425e-a832-341edc22beb3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:39.670994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbd538-2ad4-4168-a65c-318f73c3c263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:39.671675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbd538-2ad4-4168-a65c-318f73c3c263 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:39.671995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbd538-2ad4-4168-a65c-318f73c3c263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:39.672270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbd538-2ad4-4168-a65c-318f73c3c263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:39.682024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbd538-2ad4-4168-a65c-318f73c3c263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:39.683473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbd538-2ad4-4168-a65c-318f73c3c263 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:39.692743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 725/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:42.395380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df710f9f-df92-4a05-aefc-642f557190fd None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:42.395997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df710f9f-df92-4a05-aefc-642f557190fd None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:42.395997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df710f9f-df92-4a05-aefc-642f557190fd None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:42.397344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:21:42.403808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6867f2-1d37-4e18-980f-b1cc49ed264d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:42.404284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6867f2-1d37-4e18-980f-b1cc49ed264d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:42.404392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6867f2-1d37-4e18-980f-b1cc49ed264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:42.422841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ff6867f2-1d37-4e18-980f-b1cc49ed264d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:42.424118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ff6867f2-1d37-4e18-980f-b1cc49ed264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:42.432892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:42.470595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df710f9f-df92-4a05-aefc-642f557190fd None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:42.481767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df710f9f-df92-4a05-aefc-642f557190fd None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:42.485307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b49a4b-4a56-4e6b-a3a6-e56ed24a8095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:42.485965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49a4b-4a56-4e6b-a3a6-e56ed24a8095 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:42.486248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49a4b-4a56-4e6b-a3a6-e56ed24a8095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:42.486526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49a4b-4a56-4e6b-a3a6-e56ed24a8095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:42.496258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49a4b-4a56-4e6b-a3a6-e56ed24a8095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:42.497635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49a4b-4a56-4e6b-a3a6-e56ed24a8095 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:42.506947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 723/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:44.912854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999df9-5b37-4c03-9680-36a6b083b15d None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:44.913568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999df9-5b37-4c03-9680-36a6b083b15d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:44.913568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999df9-5b37-4c03-9680-36a6b083b15d None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:44.914953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:44.920258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262678-0f78-49ad-981a-1e9a9029b025 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:44.920727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262678-0f78-49ad-981a-1e9a9029b025 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:44.920828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262678-0f78-49ad-981a-1e9a9029b025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:44.938518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d6262678-0f78-49ad-981a-1e9a9029b025 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:44.939717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d6262678-0f78-49ad-981a-1e9a9029b025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:44.948019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:44.987629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999df9-5b37-4c03-9680-36a6b083b15d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:44.998975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999df9-5b37-4c03-9680-36a6b083b15d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:45.002460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39aca2-cf32-4790-b586-e001ce542a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:45.003090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39aca2-cf32-4790-b586-e001ce542a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:45.003404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39aca2-cf32-4790-b586-e001ce542a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:45.003679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39aca2-cf32-4790-b586-e001ce542a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:45.012833 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39aca2-cf32-4790-b586-e001ce542a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:45.014243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39aca2-cf32-4790-b586-e001ce542a5a service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:45.024183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 728/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:47.314616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cefa8-94e9-4018-a77e-86eb9e4d2774 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:47.315167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cefa8-94e9-4018-a77e-86eb9e4d2774 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:47.315167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cefa8-94e9-4018-a77e-86eb9e4d2774 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:47.316558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:47.321955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903872b-c718-40ad-9b68-3cab3f233a2e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:47.322365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903872b-c718-40ad-9b68-3cab3f233a2e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:47.322505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903872b-c718-40ad-9b68-3cab3f233a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:47.340080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d903872b-c718-40ad-9b68-3cab3f233a2e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:47.341249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d903872b-c718-40ad-9b68-3cab3f233a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:47.348866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:47.387860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cefa8-94e9-4018-a77e-86eb9e4d2774 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:47.398440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cefa8-94e9-4018-a77e-86eb9e4d2774 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:47.401902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d6f5b-0715-4996-87c6-cf60cfe459a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:47.402530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d6f5b-0715-4996-87c6-cf60cfe459a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:47.402809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d6f5b-0715-4996-87c6-cf60cfe459a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:47.403081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d6f5b-0715-4996-87c6-cf60cfe459a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:47.411730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d6f5b-0715-4996-87c6-cf60cfe459a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:47.413658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d6f5b-0715-4996-87c6-cf60cfe459a0 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:47.422745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 726/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:49.697791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab711cc-9054-45b1-9996-2543c2ece5c2 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:49.698355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab711cc-9054-45b1-9996-2543c2ece5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:49.698355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab711cc-9054-45b1-9996-2543c2ece5c2 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:49.699739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:49.705022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a97e-99a1-41fe-8906-dde027618197 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:49.705469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a97e-99a1-41fe-8906-dde027618197 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:49.705606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a97e-99a1-41fe-8906-dde027618197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:49.723910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3bc6a97e-99a1-41fe-8906-dde027618197 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:49.725095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3bc6a97e-99a1-41fe-8906-dde027618197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:49.733515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:49.774222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab711cc-9054-45b1-9996-2543c2ece5c2 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:49.784573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab711cc-9054-45b1-9996-2543c2ece5c2 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:49.788049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d84660-c6ad-4b5a-ae21-8dfb6802df81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:49.788670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84660-c6ad-4b5a-ae21-8dfb6802df81 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:49.788947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84660-c6ad-4b5a-ae21-8dfb6802df81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:49.789218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84660-c6ad-4b5a-ae21-8dfb6802df81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:49.797831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d84660-c6ad-4b5a-ae21-8dfb6802df81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:49.799347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d84660-c6ad-4b5a-ae21-8dfb6802df81 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:49.808881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 731/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:52.267073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e872-332f-4c0b-8115-e7afb0b8f449 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:52.267684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e872-332f-4c0b-8115-e7afb0b8f449 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:52.267684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595e872-332f-4c0b-8115-e7afb0b8f449 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:52.269035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:52.274766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608752-8596-4a94-a5ea-28dcff5ce69a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:52.275230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608752-8596-4a94-a5ea-28dcff5ce69a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:52.275375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608752-8596-4a94-a5ea-28dcff5ce69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:52.293329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ab608752-8596-4a94-a5ea-28dcff5ce69a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:52.294546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ab608752-8596-4a94-a5ea-28dcff5ce69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:52.302237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:52.339491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e872-332f-4c0b-8115-e7afb0b8f449 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:52.350004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595e872-332f-4c0b-8115-e7afb0b8f449 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:52.354167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd477c9-f86b-4380-b2cb-2ab1c19c901f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:52.354798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd477c9-f86b-4380-b2cb-2ab1c19c901f service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:52.355085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd477c9-f86b-4380-b2cb-2ab1c19c901f service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:52.355393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd477c9-f86b-4380-b2cb-2ab1c19c901f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:52.364126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd477c9-f86b-4380-b2cb-2ab1c19c901f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:52.365854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd477c9-f86b-4380-b2cb-2ab1c19c901f service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:52.375473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 729/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:54.829048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0576-92ae-416a-9e72-32ce41f5cf24 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:54.829587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0576-92ae-416a-9e72-32ce41f5cf24 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:54.829587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed0576-92ae-416a-9e72-32ce41f5cf24 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:54.830980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:54.837152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39f80-e02e-423e-8b4a-04a1cd6a55f3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:54.837592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39f80-e02e-423e-8b4a-04a1cd6a55f3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:54.837712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39f80-e02e-423e-8b4a-04a1cd6a55f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:54.855000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cae39f80-e02e-423e-8b4a-04a1cd6a55f3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:54.856223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cae39f80-e02e-423e-8b4a-04a1cd6a55f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:54.863890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:54.905617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0576-92ae-416a-9e72-32ce41f5cf24 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:54.916965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed0576-92ae-416a-9e72-32ce41f5cf24 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:54.920556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8636c-e74a-4c9e-9b18-cfdc1db6adcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:54.921202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8636c-e74a-4c9e-9b18-cfdc1db6adcc service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:54.921486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8636c-e74a-4c9e-9b18-cfdc1db6adcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:54.921761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8636c-e74a-4c9e-9b18-cfdc1db6adcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:54.931204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8636c-e74a-4c9e-9b18-cfdc1db6adcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:54.932730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8636c-e74a-4c9e-9b18-cfdc1db6adcc service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:54.942226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 734/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:57.224165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810ef8-6739-4838-965a-5795818ebc62 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:57.224750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810ef8-6739-4838-965a-5795818ebc62 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:57.224750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810ef8-6739-4838-965a-5795818ebc62 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:57.226337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:57.231634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b004f-99d4-42c8-bd9e-e16ec7aa293a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:57.232065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b004f-99d4-42c8-bd9e-e16ec7aa293a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:57.232226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b004f-99d4-42c8-bd9e-e16ec7aa293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:57.249943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e87b004f-99d4-42c8-bd9e-e16ec7aa293a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:57.251130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e87b004f-99d4-42c8-bd9e-e16ec7aa293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:57.259507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:57.295696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810ef8-6739-4838-965a-5795818ebc62 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:57.306280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810ef8-6739-4838-965a-5795818ebc62 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:57.309815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6b139-7b09-41ed-ad5b-03e724690265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:57.310444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6b139-7b09-41ed-ad5b-03e724690265 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:57.310731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6b139-7b09-41ed-ad5b-03e724690265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:57.311009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6b139-7b09-41ed-ad5b-03e724690265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:57.320708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6b139-7b09-41ed-ad5b-03e724690265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:57.322129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6b139-7b09-41ed-ad5b-03e724690265 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:57.331537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 732/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:21:59.605149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3e5a-9258-4406-8690-743445089375 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:59.605730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3e5a-9258-4406-8690-743445089375 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:59.605730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3e5a-9258-4406-8690-743445089375 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:59.607069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:21:59.612421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a36c57-3d23-4b58-91c7-bcb182af9685 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:59.612822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a36c57-3d23-4b58-91c7-bcb182af9685 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:59.612984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a36c57-3d23-4b58-91c7-bcb182af9685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:59.631549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-15a36c57-3d23-4b58-91c7-bcb182af9685 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:21:59.632785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-15a36c57-3d23-4b58-91c7-bcb182af9685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:21:59.640882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:21:59.680777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3e5a-9258-4406-8690-743445089375 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:21:59.691408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3e5a-9258-4406-8690-743445089375 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:21:59.696100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec09f7-d116-4af1-83e0-cb2b4db205e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:21:59.696760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09f7-d116-4af1-83e0-cb2b4db205e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:21:59.697041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09f7-d116-4af1-83e0-cb2b4db205e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:21:59.697315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec09f7-d116-4af1-83e0-cb2b4db205e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:21:59.706045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09f7-d116-4af1-83e0-cb2b4db205e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:21:59.707492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec09f7-d116-4af1-83e0-cb2b4db205e8 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:21:59.717257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 737/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:22:33.562521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211c69-d534-4e23-9885-5e50207190a8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:33.563126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211c69-d534-4e23-9885-5e50207190a8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:33.563126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211c69-d534-4e23-9885-5e50207190a8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:33.564536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 734/1471] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:33.570196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c146-7542-41dc-884c-17cdb90ac84c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:33.570662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c146-7542-41dc-884c-17cdb90ac84c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:33.570772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c146-7542-41dc-884c-17cdb90ac84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:33.588476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4b74c146-7542-41dc-884c-17cdb90ac84c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:33.589651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4b74c146-7542-41dc-884c-17cdb90ac84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:33.597385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 738/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:33.644902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d875f-ef8f-48d6-9eba-789b726fda3a None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:33.645190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d875f-ef8f-48d6-9eba-789b726fda3a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:33.645589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d875f-ef8f-48d6-9eba-789b726fda3a None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:33.646950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 735/1473] 10.222.0.42 () {54 vars in 962 bytes} [Tue May 3 16:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:33.651878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e754ce-b109-4b3e-bbc4-fe7e1d09b508 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:33.652169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e754ce-b109-4b3e-bbc4-fe7e1d09b508 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:33.652488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e754ce-b109-4b3e-bbc4-fe7e1d09b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:33.670148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-57e754ce-b109-4b3e-bbc4-fe7e1d09b508 None None] MFA Rules not processed for user `0545d7ffc7b84827a5f64629b0e447f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:33.673332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-57e754ce-b109-4b3e-bbc4-fe7e1d09b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:33.678349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 739/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Tue May 3 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:33.685637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d875f-ef8f-48d6-9eba-789b726fda3a None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:33.696446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d875f-ef8f-48d6-9eba-789b726fda3a None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:33.700000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca2d1d-187c-4467-8796-3fc7bf80d790 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:33.700633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2d1d-187c-4467-8796-3fc7bf80d790 service glance] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:33.700921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2d1d-187c-4467-8796-3fc7bf80d790 service glance] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:33.701203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2d1d-187c-4467-8796-3fc7bf80d790 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:33.710963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca2d1d-187c-4467-8796-3fc7bf80d790 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:33.713541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca2d1d-187c-4467-8796-3fc7bf80d790 service glance] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:33.721843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 736/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:22:36.033165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b92b45-e281-4531-b14e-00872cc8f7ef None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:36.033784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b92b45-e281-4531-b14e-00872cc8f7ef None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:36.033784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b92b45-e281-4531-b14e-00872cc8f7ef None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:36.035121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 740/1476] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:36.040785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831f8a-e3b4-4abf-bb8a-8f45ee2c4d9e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:36.041251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831f8a-e3b4-4abf-bb8a-8f45ee2c4d9e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:36.041360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831f8a-e3b4-4abf-bb8a-8f45ee2c4d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:36.058724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c8831f8a-e3b4-4abf-bb8a-8f45ee2c4d9e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:36.059960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c8831f8a-e3b4-4abf-bb8a-8f45ee2c4d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:36.068283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 737/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:36.091890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b92b45-e281-4531-b14e-00872cc8f7ef None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:36.104072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b92b45-e281-4531-b14e-00872cc8f7ef None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:36.108420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:36.109056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:36.109359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:36.109629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:36.110347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:36.112099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:22:36.112099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:22:36.112099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:22:36.113492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a30cc4-e9a0-4fde-8bc5-576bef4be56f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:36.134147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 741/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Tue May 3 16:22:36 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:22:38.374128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5d47-920b-4060-b59e-9157fa43f8c2 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:38.374709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5d47-920b-4060-b59e-9157fa43f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:38.374709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5d47-920b-4060-b59e-9157fa43f8c2 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:38.376063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 738/1479] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:38.381322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dba48-c08d-4243-9c0a-feedd60475e3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:38.381735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dba48-c08d-4243-9c0a-feedd60475e3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:38.381884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dba48-c08d-4243-9c0a-feedd60475e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:38.399411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7f1dba48-c08d-4243-9c0a-feedd60475e3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:38.400596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7f1dba48-c08d-4243-9c0a-feedd60475e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:38.408297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 742/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:38.450546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5d47-920b-4060-b59e-9157fa43f8c2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:38.464781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5d47-920b-4060-b59e-9157fa43f8c2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:38.470068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed813-8cf3-463a-adb2-5d2185c2fa66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:38.470686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed813-8cf3-463a-adb2-5d2185c2fa66 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:38.470996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed813-8cf3-463a-adb2-5d2185c2fa66 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:38.471295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed813-8cf3-463a-adb2-5d2185c2fa66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:38.479875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed813-8cf3-463a-adb2-5d2185c2fa66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:38.481522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed813-8cf3-463a-adb2-5d2185c2fa66 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:38.493128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 739/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:22:40.888727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782041a-0003-46de-a382-8a5f5414d695 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:40.889328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782041a-0003-46de-a382-8a5f5414d695 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:40.889328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782041a-0003-46de-a382-8a5f5414d695 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:40.890754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 743/1482] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:40.896395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824d0d6-bdd6-4883-a9b0-fa447155661e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:40.896845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824d0d6-bdd6-4883-a9b0-fa447155661e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:40.896963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824d0d6-bdd6-4883-a9b0-fa447155661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:40.914969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c824d0d6-bdd6-4883-a9b0-fa447155661e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:40.916184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c824d0d6-bdd6-4883-a9b0-fa447155661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:40.923859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 740/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:40.958454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782041a-0003-46de-a382-8a5f5414d695 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:40.968794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782041a-0003-46de-a382-8a5f5414d695 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:40.972226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21185be8-e203-4caf-aef3-3feb9fdf04e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:40.972846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21185be8-e203-4caf-aef3-3feb9fdf04e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:40.973123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21185be8-e203-4caf-aef3-3feb9fdf04e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:40.974071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21185be8-e203-4caf-aef3-3feb9fdf04e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:40.982614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21185be8-e203-4caf-aef3-3feb9fdf04e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:40.984051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21185be8-e203-4caf-aef3-3feb9fdf04e6 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:40.993805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 744/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:22:43.303667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bdcab-4e28-4435-bac2-8ac005f8fc8f None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:43.304247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bdcab-4e28-4435-bac2-8ac005f8fc8f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:43.304247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bdcab-4e28-4435-bac2-8ac005f8fc8f None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:43.305629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 741/1485] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:43.310800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6289d-1c1c-4c21-ae3b-2ec929198cc3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:43.311238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6289d-1c1c-4c21-ae3b-2ec929198cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:43.311387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6289d-1c1c-4c21-ae3b-2ec929198cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:43.328506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1ae6289d-1c1c-4c21-ae3b-2ec929198cc3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:43.329691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1ae6289d-1c1c-4c21-ae3b-2ec929198cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:43.338008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 745/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:43.375728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bdcab-4e28-4435-bac2-8ac005f8fc8f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:43.386404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bdcab-4e28-4435-bac2-8ac005f8fc8f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:43.389879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fcd8b-21da-4f57-a90e-adfa454a929d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:43.390507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fcd8b-21da-4f57-a90e-adfa454a929d service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:43.390792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fcd8b-21da-4f57-a90e-adfa454a929d service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:43.391070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fcd8b-21da-4f57-a90e-adfa454a929d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:43.400413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fcd8b-21da-4f57-a90e-adfa454a929d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:43.401820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fcd8b-21da-4f57-a90e-adfa454a929d service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:43.411290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 742/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:22:45.729407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ae22-78fc-423e-a945-ebeebc7a572e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:45.729979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ae22-78fc-423e-a945-ebeebc7a572e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:45.729979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ae22-78fc-423e-a945-ebeebc7a572e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:45.731380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 746/1488] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:45.736401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678049c5-27e4-429f-9683-eb7060a47f7e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:45.736814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678049c5-27e4-429f-9683-eb7060a47f7e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:45.736956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678049c5-27e4-429f-9683-eb7060a47f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:45.754798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-678049c5-27e4-429f-9683-eb7060a47f7e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:45.756013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-678049c5-27e4-429f-9683-eb7060a47f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:45.763642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 743/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:45.802869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ae22-78fc-423e-a945-ebeebc7a572e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:45.813258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ae22-78fc-423e-a945-ebeebc7a572e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:45.817241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e54b-a215-4ab6-a611-370a4bb84a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:45.817874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e54b-a215-4ab6-a611-370a4bb84a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:45.818156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e54b-a215-4ab6-a611-370a4bb84a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:45.818432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e54b-a215-4ab6-a611-370a4bb84a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:45.827091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e54b-a215-4ab6-a611-370a4bb84a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:45.828543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e54b-a215-4ab6-a611-370a4bb84a07 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:45.838404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 747/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:22:48.397828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1129b-c891-4167-81a9-1c37ffd7a68b None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:48.398382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1129b-c891-4167-81a9-1c37ffd7a68b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:48.398483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1129b-c891-4167-81a9-1c37ffd7a68b None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:48.399804 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 744/1491] 10.222.0.42 () {54 vars in 926 bytes} [Tue May 3 16:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:22:48.405035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42a13-6d77-4f78-ab2a-b766aff37a07 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:48.405432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42a13-6d77-4f78-ab2a-b766aff37a07 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:48.405596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42a13-6d77-4f78-ab2a-b766aff37a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:48.423676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d7b42a13-6d77-4f78-ab2a-b766aff37a07 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:22:48.431922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d7b42a13-6d77-4f78-ab2a-b766aff37a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:22:48.432859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 748/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Tue May 3 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:22:48.470850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1129b-c891-4167-81a9-1c37ffd7a68b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:22:48.481925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1129b-c891-4167-81a9-1c37ffd7a68b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:22:48.485357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f07927-5f8e-4a3c-a348-0da44324ba2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:22:48.485983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f07927-5f8e-4a3c-a348-0da44324ba2c service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:22:48.486274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f07927-5f8e-4a3c-a348-0da44324ba2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:22:48.486545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f07927-5f8e-4a3c-a348-0da44324ba2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:22:48.495578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f07927-5f8e-4a3c-a348-0da44324ba2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:22:48.496993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f07927-5f8e-4a3c-a348-0da44324ba2c service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:22:48.506397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 745/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:24:25.066976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.067601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.067601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.085716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:24:25.086890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:24:25.098425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 749/1494] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:24:25.106253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.106744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.106852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.125782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:24:25.126652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:24:25.134407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 746/1495] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:24:25.138790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.148920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76dd51-1b80-43b2-8a5c-1635f47536d0 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.153508 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.154156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.154434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.154704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.155454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:24:25.155756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.156772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:25.156772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:24:25.156772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:24:25.157638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.168957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 750/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:24:25.177258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.186126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377eab4-1677-4d77-a4fb-9a49600f9993 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.191148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.191821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.192101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.192374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.193049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.194790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:25.194790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:24:25.194790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:24:25.196001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.300070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 747/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:24:25 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:24:25.304230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.314941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec964177-924e-4e6b-aa30-4bcfe7eb2e5f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.371162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.371855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.372199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.372414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.373105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.374128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:25.374128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:24:25.374128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:24:25.376138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.466971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 751/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:24:25 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:24:25.471525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.481624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ae03e-99d5-4163-8e7a-7b216f7fcb0e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.486536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.488137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.488137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.488137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.488524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.489533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:25.489533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:24:25.489533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:24:25.490412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.504700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 748/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:24:25.508770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.519501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29946-6f88-474a-9827-d8100b685c1c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.524060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.524736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.525016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.525287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.525996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.526996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:25.526996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:24:25.526996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:24:25.527903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d3a1f-9f26-43b5-9412-90d38d9ddbe7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.542090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 752/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:24:25.546258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.557072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab935ad8-830f-4613-a196-967e75a957db admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.561672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.563491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.563858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.564134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] PATH_INFO: `/v3/projects/d79ef126866c43738da044c9e3f34c1a/users/9de6785e321e44c9a9c550816df1e0c3/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.577921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79ef126866c43738da044c9e3f34c1a, user_id=9de6785e321e44c9a9c550816df1e0c3, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.579170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:25.579170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:24:25.579170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:24:25.581104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.690141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 749/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:24:25 2022] PUT /identity/v3/projects/d79ef126866c43738da044c9e3f34c1a/users/9de6785e321e44c9a9c550816df1e0c3/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:24:25.701257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd553b-9dc6-40a6-a92c-e952f8da73fa None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.701548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd553b-9dc6-40a6-a92c-e952f8da73fa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.701852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd553b-9dc6-40a6-a92c-e952f8da73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.728164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3efd553b-9dc6-40a6-a92c-e952f8da73fa None None] MFA Rules not processed for user `9de6785e321e44c9a9c550816df1e0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:24:25.729383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3efd553b-9dc6-40a6-a92c-e952f8da73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:24:25.791085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 753/1502] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:24:25.802323 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:25.869225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4555-8cdd-44f8-9d71-5c065574d026 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:25.874590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:25.875833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.876116 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.876383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.883902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:25.885474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:25.894042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 750/1503] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:24:25.963686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8cd6-d0c1-40c0-b158-fa64ddfbc0f3 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:25.964003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8cd6-d0c1-40c0-b158-fa64ddfbc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:25.964277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8cd6-d0c1-40c0-b158-fa64ddfbc0f3 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:25.965689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 754/1504] 10.222.0.42 () {52 vars in 829 bytes} [Tue May 3 16:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:24:25.969888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:26.028559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc0be-12c3-4e57-b95a-639d9d3d63b8 service nova] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:26.033801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:26.034662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:26.034945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:26.035223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] PATH_INFO: `/v3/users/9de6785e321e44c9a9c550816df1e0c3` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:26.036418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de6785e321e44c9a9c550816df1e0c3)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:26.037435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:26.037435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:24:26.037435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:24:26.038617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:26.187288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de6785e321e44c9a9c550816df1e0c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:26.200147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de6785e321e44c9a9c550816df1e0c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:26.201365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de6785e321e44c9a9c550816df1e0c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:26.201985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de6785e321e44c9a9c550816df1e0c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:26.219920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de6785e321e44c9a9c550816df1e0c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:26.279478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 751/1505] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:24:25 2022] DELETE /identity/v3/users/9de6785e321e44c9a9c550816df1e0c3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:24:26.284579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:26.285076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:26.285176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:26.302769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:24:26.303987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:24:26.365384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 755/1506] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:24:26.374839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:26.376401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:24:26.433304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11831da8-4cf3-403c-9a86-496aa632b54a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:26.437899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb05c0-28de-4a39-96f2-a2c8e4c8ba04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:26.437899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb05c0-28de-4a39-96f2-a2c8e4c8ba04 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:26.438220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb05c0-28de-4a39-96f2-a2c8e4c8ba04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:26.438488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb05c0-28de-4a39-96f2-a2c8e4c8ba04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:26.447718 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb05c0-28de-4a39-96f2-a2c8e4c8ba04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:26.449192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb05c0-28de-4a39-96f2-a2c8e4c8ba04 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:26.459640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 752/1507] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:24:26.959475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:24:26.961065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:24:26.973884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8997c4b-de5a-40c1-a870-b1176af5103b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:24:26.978470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:24:26.979370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:24:26.979657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:24:26.979956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] PATH_INFO: `/v3/projects/d79ef126866c43738da044c9e3f34c1a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:24:26.981152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79ef126866c43738da044c9e3f34c1a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:24:26.982283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:24:26.982283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:24:26.982283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:24:26.983679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:24:27.096336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79ef126866c43738da044c9e3f34c1a', 'request_id': 'req-475ee379-0eed-439c-bd62-a96a6a135401'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:27.164357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79ef126866c43738da044c9e3f34c1a', 'request_id': 'req-475ee379-0eed-439c-bd62-a96a6a135401'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:27.175023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79ef126866c43738da044c9e3f34c1a', 'request_id': 'req-475ee379-0eed-439c-bd62-a96a6a135401'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:27.194701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] The token cache is being invalidate because project d79ef126866c43738da044c9e3f34c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:24:27.194987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:27.195649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-475ee379-0eed-439c-bd62-a96a6a135401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:24:27.197329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 756/1508] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:24:26 2022] DELETE /identity/v3/projects/d79ef126866c43738da044c9e3f34c1a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:26:04.174485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8ce7-ea0a-4a20-a05a-3b50f83ae967 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:04.175141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8ce7-ea0a-4a20-a05a-3b50f83ae967 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:04.175241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8ce7-ea0a-4a20-a05a-3b50f83ae967 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:04.176687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 753/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:04.181629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2b0ad-a159-453f-bed3-9cf31cc1366d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:04.182099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2b0ad-a159-453f-bed3-9cf31cc1366d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:04.182220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2b0ad-a159-453f-bed3-9cf31cc1366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:04.201307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e3d2b0ad-a159-453f-bed3-9cf31cc1366d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:04.202660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e3d2b0ad-a159-453f-bed3-9cf31cc1366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:04.260879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 757/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:04.423043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8ce7-ea0a-4a20-a05a-3b50f83ae967 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:04.424970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-08ec8ce7-ea0a-4a20-a05a-3b50f83ae967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:04.499991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8ce7-ea0a-4a20-a05a-3b50f83ae967 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:04.505679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757a2ef-a619-47e7-ab3f-0a1becb3ca05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:04.506301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757a2ef-a619-47e7-ab3f-0a1becb3ca05 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:04.506587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757a2ef-a619-47e7-ab3f-0a1becb3ca05 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:04.506865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757a2ef-a619-47e7-ab3f-0a1becb3ca05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:04.515805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757a2ef-a619-47e7-ab3f-0a1becb3ca05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:04.517391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757a2ef-a619-47e7-ab3f-0a1becb3ca05 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:04.526548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 754/1511] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:05.783860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86fcc-6d7c-4c2c-8066-db3faa9f1b7c None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:05.784422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86fcc-6d7c-4c2c-8066-db3faa9f1b7c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:05.784422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb86fcc-6d7c-4c2c-8066-db3faa9f1b7c None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:05.785826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 758/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:05.790530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6f45-cdb4-4ebb-817d-634418ee4e8a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:05.790982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6f45-cdb4-4ebb-817d-634418ee4e8a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:05.791082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6f45-cdb4-4ebb-817d-634418ee4e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:05.809483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a85a6f45-cdb4-4ebb-817d-634418ee4e8a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:05.810656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a85a6f45-cdb4-4ebb-817d-634418ee4e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:05.818322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 755/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:05.931905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a7e0-8f63-4077-866a-ba1be8221abe None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:05.932193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a7e0-8f63-4077-866a-ba1be8221abe None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:05.932471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a7e0-8f63-4077-866a-ba1be8221abe None None] PATH_INFO: `/v3` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:05.934347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 759/1514] 10.222.0.36 () {54 vars in 925 bytes} [Tue May 3 16:26:05 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:26:05.940636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0a590-095d-4c00-9eba-e3df67ff64c8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:05.940925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0a590-095d-4c00-9eba-e3df67ff64c8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:05.941205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0a590-095d-4c00-9eba-e3df67ff64c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:05.960960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ceb0a590-095d-4c00-9eba-e3df67ff64c8 None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:05.962154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ceb0a590-095d-4c00-9eba-e3df67ff64c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:05.970454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a7e0-8f63-4077-866a-ba1be8221abe None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:05.985464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a7e0-8f63-4077-866a-ba1be8221abe None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:05.990768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8233c3-f456-4992-8d42-26c86317adfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:05.991429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8233c3-f456-4992-8d42-26c86317adfe service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:05.991713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8233c3-f456-4992-8d42-26c86317adfe service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:05.991986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8233c3-f456-4992-8d42-26c86317adfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:06.000398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8233c3-f456-4992-8d42-26c86317adfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:06.001998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8233c3-f456-4992-8d42-26c86317adfe service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:06.011248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 760/1515] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:26:06.026601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 756/1516] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:10.217775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587291c1-3117-472f-bca0-f19a3727137e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:10.218291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587291c1-3117-472f-bca0-f19a3727137e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:10.218291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587291c1-3117-472f-bca0-f19a3727137e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:10.219665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 761/1517] 10.222.0.42 () {54 vars in 960 bytes} [Tue May 3 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:10.224804 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c909c-c5c0-4cc1-bcf4-d4d4ddd5775c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:10.225299 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c909c-c5c0-4cc1-bcf4-d4d4ddd5775c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:10.225409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c909c-c5c0-4cc1-bcf4-d4d4ddd5775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:10.243315 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b32c909c-c5c0-4cc1-bcf4-d4d4ddd5775c None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:10.244489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b32c909c-c5c0-4cc1-bcf4-d4d4ddd5775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:10.253418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 757/1518] 10.222.0.42 () {58 vars in 1057 bytes} [Tue May 3 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:10.260605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587291c1-3117-472f-bca0-f19a3727137e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:10.274270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587291c1-3117-472f-bca0-f19a3727137e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:10.279617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bb40b-7bd2-4b14-b156-1b8ab25d2683 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:10.280244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb40b-7bd2-4b14-b156-1b8ab25d2683 service placement] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:10.280551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb40b-7bd2-4b14-b156-1b8ab25d2683 service placement] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:10.280823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bb40b-7bd2-4b14-b156-1b8ab25d2683 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:10.289139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bb40b-7bd2-4b14-b156-1b8ab25d2683 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:10.290712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bb40b-7bd2-4b14-b156-1b8ab25d2683 service placement] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:10.300873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 762/1519] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:17.641313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b98f9-cb17-49f5-808a-6a049866cca5 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:17.641948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b98f9-cb17-49f5-808a-6a049866cca5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:17.641948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b98f9-cb17-49f5-808a-6a049866cca5 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:17.643229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 758/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:17.647869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef2d3e-995b-42c0-a406-2559ad96e910 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:17.648280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef2d3e-995b-42c0-a406-2559ad96e910 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:17.648423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef2d3e-995b-42c0-a406-2559ad96e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:17.666008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-acef2d3e-995b-42c0-a406-2559ad96e910 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:17.667432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-acef2d3e-995b-42c0-a406-2559ad96e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:17.675075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 763/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:17.825039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b98f9-cb17-49f5-808a-6a049866cca5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:17.839369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b98f9-cb17-49f5-808a-6a049866cca5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:17.844788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a08b0-e3d7-419c-a14f-899579af3663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:17.845421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a08b0-e3d7-419c-a14f-899579af3663 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:17.845730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a08b0-e3d7-419c-a14f-899579af3663 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:17.846011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a08b0-e3d7-419c-a14f-899579af3663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:17.854248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a08b0-e3d7-419c-a14f-899579af3663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:17.855902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a08b0-e3d7-419c-a14f-899579af3663 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:17.865110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 759/1522] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:19.110862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2d659-bc96-421b-b0b3-d1a7cc52d2ab None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:19.111465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2d659-bc96-421b-b0b3-d1a7cc52d2ab None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:19.111465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2d659-bc96-421b-b0b3-d1a7cc52d2ab None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:19.112872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 764/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:19.117533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416155-3a1a-4604-92fa-bb9f16b0631e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:19.117983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416155-3a1a-4604-92fa-bb9f16b0631e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:19.118094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416155-3a1a-4604-92fa-bb9f16b0631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:19.137086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b3416155-3a1a-4604-92fa-bb9f16b0631e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:19.138266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b3416155-3a1a-4604-92fa-bb9f16b0631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:19.145958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 760/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:19.296514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2d659-bc96-421b-b0b3-d1a7cc52d2ab None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:19.311149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2d659-bc96-421b-b0b3-d1a7cc52d2ab None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:19.316540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec446-4106-4e11-8097-df66cb80f540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:19.317174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec446-4106-4e11-8097-df66cb80f540 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:19.317455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec446-4106-4e11-8097-df66cb80f540 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:19.317729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec446-4106-4e11-8097-df66cb80f540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:19.326662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ec446-4106-4e11-8097-df66cb80f540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:19.328276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ec446-4106-4e11-8097-df66cb80f540 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:19.337460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 765/1525] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:23.407982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeb5a9-d80f-422d-8978-51bd30990d27 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:23.408556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeb5a9-d80f-422d-8978-51bd30990d27 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:23.408556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deeb5a9-d80f-422d-8978-51bd30990d27 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:23.409927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 761/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:23.415090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5a46-1302-4836-b3ed-9bdeced054a5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:23.415622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5a46-1302-4836-b3ed-9bdeced054a5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:23.415720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5a46-1302-4836-b3ed-9bdeced054a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:23.434721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-edfc5a46-1302-4836-b3ed-9bdeced054a5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:23.435929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-edfc5a46-1302-4836-b3ed-9bdeced054a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:23.443667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 766/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:26:23.478646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeb5a9-d80f-422d-8978-51bd30990d27 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:23.480883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2deeb5a9-d80f-422d-8978-51bd30990d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:23.539668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deeb5a9-d80f-422d-8978-51bd30990d27 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:23.543862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75748b-283a-453c-86a1-d3acb16877ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:23.544526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75748b-283a-453c-86a1-d3acb16877ee service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:23.544829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75748b-283a-453c-86a1-d3acb16877ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:23.545107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75748b-283a-453c-86a1-d3acb16877ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:23.554246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75748b-283a-453c-86a1-d3acb16877ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:23.560741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75748b-283a-453c-86a1-d3acb16877ee service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:23.565788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 762/1528] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:25.782743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42e15-c5a0-4dd5-b130-a31b82537c1e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:25.783316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42e15-c5a0-4dd5-b130-a31b82537c1e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:25.783316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42e15-c5a0-4dd5-b130-a31b82537c1e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:25.784724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 767/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:25.789769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7f2e-32e5-46de-ae84-975166065f94 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:25.790178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7f2e-32e5-46de-ae84-975166065f94 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:25.790328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7f2e-32e5-46de-ae84-975166065f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:25.808187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d9de7f2e-32e5-46de-ae84-975166065f94 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:25.809377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d9de7f2e-32e5-46de-ae84-975166065f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:25.817080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 763/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:25.853721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42e15-c5a0-4dd5-b130-a31b82537c1e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:25.855635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-54a42e15-c5a0-4dd5-b130-a31b82537c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:25.868333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42e15-c5a0-4dd5-b130-a31b82537c1e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:25.872602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6c8b0-c724-402b-9c2e-e0f7ef813fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:25.873220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6c8b0-c724-402b-9c2e-e0f7ef813fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:25.873498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6c8b0-c724-402b-9c2e-e0f7ef813fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:25.873772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6c8b0-c724-402b-9c2e-e0f7ef813fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:25.882354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6c8b0-c724-402b-9c2e-e0f7ef813fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:25.883793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6c8b0-c724-402b-9c2e-e0f7ef813fa9 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:25.893449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 768/1531] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:29.639792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a65a-852f-44c1-8482-950b18ba3374 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:29.640352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a65a-852f-44c1-8482-950b18ba3374 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:29.640449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6a65a-852f-44c1-8482-950b18ba3374 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:29.641764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 764/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:29.647113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709966cd-4b9b-4c37-a930-356d48a08553 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:29.647568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709966cd-4b9b-4c37-a930-356d48a08553 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:29.647688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709966cd-4b9b-4c37-a930-356d48a08553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:29.668571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-709966cd-4b9b-4c37-a930-356d48a08553 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:29.669761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-709966cd-4b9b-4c37-a930-356d48a08553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:29.677911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 769/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:29.949124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a65a-852f-44c1-8482-950b18ba3374 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:29.950776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e4b6a65a-852f-44c1-8482-950b18ba3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:30.006844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6a65a-852f-44c1-8482-950b18ba3374 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:30.010385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e49b-7270-4afc-be1b-5d086d46a84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:30.011748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e49b-7270-4afc-be1b-5d086d46a84c service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:30.012130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e49b-7270-4afc-be1b-5d086d46a84c service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:30.012416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e49b-7270-4afc-be1b-5d086d46a84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:30.021105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e49b-7270-4afc-be1b-5d086d46a84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:30.022524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e49b-7270-4afc-be1b-5d086d46a84c service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:30.032399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 765/1534] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:26:32.345256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77dc7-6698-49f6-9152-d220bb8d900e None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:32.345831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77dc7-6698-49f6-9152-d220bb8d900e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:32.345831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77dc7-6698-49f6-9152-d220bb8d900e None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:32.347229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 770/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 16:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:32.352723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3f53f-f6c4-45aa-9af6-959fe73e3c2a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:32.353129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3f53f-f6c4-45aa-9af6-959fe73e3c2a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:32.353321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3f53f-f6c4-45aa-9af6-959fe73e3c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:32.372025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b4b3f53f-f6c4-45aa-9af6-959fe73e3c2a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:32.373193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b4b3f53f-f6c4-45aa-9af6-959fe73e3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:32.380840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 766/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 16:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:32.648270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11765-2439-4b0d-988d-3f49ee3e8e76 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:32.648559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11765-2439-4b0d-988d-3f49ee3e8e76 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:32.648837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11765-2439-4b0d-988d-3f49ee3e8e76 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:32.650214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 771/1537] 10.222.0.42 () {54 vars in 963 bytes} [Tue May 3 16:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:26:32.655081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b5eb-02b5-4ccc-85ee-77a8d2123e0b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:32.655413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b5eb-02b5-4ccc-85ee-77a8d2123e0b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:32.655695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b5eb-02b5-4ccc-85ee-77a8d2123e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:32.673287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0861b5eb-02b5-4ccc-85ee-77a8d2123e0b None None] MFA Rules not processed for user `6d24cf5fddb64b1096184a842975ae3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:26:32.674455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0861b5eb-02b5-4ccc-85ee-77a8d2123e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:26:32.681136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 767/1538] 10.222.0.42 () {58 vars in 1060 bytes} [Tue May 3 16:26:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:26:32.688993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11765-2439-4b0d-988d-3f49ee3e8e76 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:26:32.700148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11765-2439-4b0d-988d-3f49ee3e8e76 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:26:32.703929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7003c5-fd4c-4146-acde-66fa9c03ec9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:26:32.704608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7003c5-fd4c-4146-acde-66fa9c03ec9b service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:26:32.704890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7003c5-fd4c-4146-acde-66fa9c03ec9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:26:32.705168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7003c5-fd4c-4146-acde-66fa9c03ec9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:26:32.714667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7003c5-fd4c-4146-acde-66fa9c03ec9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:26:32.716119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7003c5-fd4c-4146-acde-66fa9c03ec9b service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:26:32.725683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 772/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:02.387442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.388108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.388108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.414028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.415295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.430837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 768/1540] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.442110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1d0e-7313-4870-ad62-94759ae309bd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.443164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1d0e-7313-4870-ad62-94759ae309bd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.443696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d1d0e-7313-4870-ad62-94759ae309bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.475636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d97d1d0e-7313-4870-ad62-94759ae309bd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.477316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d97d1d0e-7313-4870-ad62-94759ae309bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.492814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 773/1541] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.498553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:02.515279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c8bd-f8f9-4342-b444-3aa1e6697912 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:02.521405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:02.522337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.522832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.523352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.524295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:02.525342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:02.526921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 16:28:02.526921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:28:02.526921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:28:02.528233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:02.542499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 769/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:02.554700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:02.555484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6035a-53a6-4938-b5e3-f0c00bff7aee None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.556125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6035a-53a6-4938-b5e3-f0c00bff7aee None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.556621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6035a-53a6-4938-b5e3-f0c00bff7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.565752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878829f-85c4-4b34-872a-1f35c65a23c0 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:02.575692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ad46f-418d-4dbf-ab47-5391480c1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:02.582065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ad46f-418d-4dbf-ab47-5391480c1d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.582065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ad46f-418d-4dbf-ab47-5391480c1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.582065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ad46f-418d-4dbf-ab47-5391480c1d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.582065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ad46f-418d-4dbf-ab47-5391480c1d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:02.582065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ad46f-418d-4dbf-ab47-5391480c1d27 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:02.589860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-52d6035a-53a6-4938-b5e3-f0c00bff7aee None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.591562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-52d6035a-53a6-4938-b5e3-f0c00bff7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.611982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 774/1543] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.624000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85b2-c0a0-40ba-8ad9-28fc7e7e5a9a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.624632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85b2-c0a0-40ba-8ad9-28fc7e7e5a9a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.625187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85b2-c0a0-40ba-8ad9-28fc7e7e5a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.654998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-6b0a85b2-c0a0-40ba-8ad9-28fc7e7e5a9a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.655191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6b0a85b2-c0a0-40ba-8ad9-28fc7e7e5a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.671890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 775/1544] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 03 16:28:02.673067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.673373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.673919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.694975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 770/1545] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:02.696751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54088e5-2e73-41f2-a8bc-a64978e4b56a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.697061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54088e5-2e73-41f2-a8bc-a64978e4b56a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.697389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54088e5-2e73-41f2-a8bc-a64978e4b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.716693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.717904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.723161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e54088e5-2e73-41f2-a8bc-a64978e4b56a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.724330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e54088e5-2e73-41f2-a8bc-a64978e4b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.784745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 776/1546] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.785913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:02.799232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 771/1547] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.799491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8306462-70ea-4091-a2de-c312145a9986 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:02.799589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.799589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.799589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.802761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:02.803459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.803740 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.804014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.804734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:02.805031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:02.806749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2521f-0579-4304-b3b5-3fa263497258 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:02.822839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 777/1548] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:02.822839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c298c9f-2a14-49cf-b944-c2eb0ba5ea8e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.822839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c298c9f-2a14-49cf-b944-c2eb0ba5ea8e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.823162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.823287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c298c9f-2a14-49cf-b944-c2eb0ba5ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.823391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.830469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 772/1549] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.831404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:02.841563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1c298c9f-2a14-49cf-b944-c2eb0ba5ea8e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.841902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228523-6896-4d48-a7c1-1b29b3ed47b8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:02.842773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1c298c9f-2a14-49cf-b944-c2eb0ba5ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.846647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:02.847585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.847871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.848143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.848823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:02.849822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:28:02.849822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:28:02.849822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:28:02.851010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:02.851366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 778/1550] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.852576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd015af6-41a1-42a6-81f1-7d683c1070d6 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.853544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd015af6-41a1-42a6-81f1-7d683c1070d6 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.854064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd015af6-41a1-42a6-81f1-7d683c1070d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.871621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-cd015af6-41a1-42a6-81f1-7d683c1070d6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.872808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cd015af6-41a1-42a6-81f1-7d683c1070d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.880671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 779/1551] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.894377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28a81f-fd81-43e6-a48e-9e70308a76f0 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.894377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28a81f-fd81-43e6-a48e-9e70308a76f0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.894377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28a81f-fd81-43e6-a48e-9e70308a76f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.901082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-cc28a81f-fd81-43e6-a48e-9e70308a76f0 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.902260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cc28a81f-fd81-43e6-a48e-9e70308a76f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.910169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 780/1552] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.911318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706adc6-7072-4e23-9b77-8cc447857441 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.911608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706adc6-7072-4e23-9b77-8cc447857441 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.911888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706adc6-7072-4e23-9b77-8cc447857441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.929242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0706adc6-7072-4e23-9b77-8cc447857441 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.930514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0706adc6-7072-4e23-9b77-8cc447857441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.938959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 781/1553] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.940171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf486e-4a4e-46de-8907-4700bf0500c1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.940462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf486e-4a4e-46de-8907-4700bf0500c1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.940742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf486e-4a4e-46de-8907-4700bf0500c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.958295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-22cf486e-4a4e-46de-8907-4700bf0500c1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.959473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-22cf486e-4a4e-46de-8907-4700bf0500c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.962923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 773/1554] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:02.963862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:02.968515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 782/1555] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.974961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c358fe-a113-4e26-aefe-8801d2c2dcfd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.974961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c358fe-a113-4e26-aefe-8801d2c2dcfd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.974961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c358fe-a113-4e26-aefe-8801d2c2dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.975283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797848b-8557-463c-ad00-c8c9891b2b4f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:02.980671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:02.981597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.981954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:02.982148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:02.982876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:02.985285 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:02.988968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-66c358fe-a113-4e26-aefe-8801d2c2dcfd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:02.990186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-66c358fe-a113-4e26-aefe-8801d2c2dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:02.998215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 783/1556] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:02.999828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e528-7a1d-41b0-bb12-ee09efe3d3b4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:02.999958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e528-7a1d-41b0-bb12-ee09efe3d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.000185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e528-7a1d-41b0-bb12-ee09efe3d3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.018913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-94a6e528-7a1d-41b0-bb12-ee09efe3d3b4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:03.020641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-94a6e528-7a1d-41b0-bb12-ee09efe3d3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:03.029153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 784/1557] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:03.030419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87946f8a-1a73-46f4-9136-470276fe8e52 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.030706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87946f8a-1a73-46f4-9136-470276fe8e52 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.030985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87946f8a-1a73-46f4-9136-470276fe8e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.048434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-87946f8a-1a73-46f4-9136-470276fe8e52 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:03.055047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-87946f8a-1a73-46f4-9136-470276fe8e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:03.057538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 785/1558] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:03.058733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.059023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.059338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.076564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:03.077716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:03.085713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 786/1559] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:03.099721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.099864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 774/1560] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:02 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.099864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.100050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6dab2-89d2-4abd-8fe8-8dfbe5417bb8 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.148295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370077-5381-4800-b358-fd7b472f53cd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.151223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.151937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.152236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.152501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.153223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:03.153533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.153835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.154499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.154832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.155113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.155242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.155873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.157467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.166703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 787/1561] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:03.170626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.170785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 775/1562] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:03.170785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.179483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd23f7d-e1ad-4a73-a456-33fadbd07284 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.182545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a8e54-9799-48b6-95c5-ca84a8380d1f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.184459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.185104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.185411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.185709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.186415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:03.186717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.187248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.187936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.188219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.188326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.188493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.189203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:03.189525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.191087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.200705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 776/1563] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:03.201504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.203546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 788/1564] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:03.204508 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.216385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a20a-042c-4d4f-aa3b-4f8a57e4658d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.218302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385790-991c-4662-9f9d-64ad114449ac admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.221066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.221709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.222011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.222539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.223017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.223243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:03.223673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.223783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.223952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.224228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.224936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:03.225240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.225348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.226818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.236795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 777/1565] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:03.237642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.238501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 789/1566] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:03.239329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.253622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663a58-961a-4861-add9-ae6122e63097 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.253812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142730-88c2-482b-8e4c-0504b3f2f50c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.258200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.258852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.259724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.259891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.259999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.260634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.260798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.260903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.261181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.261889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:03.262193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.262703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.263782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.276270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 790/1567] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:03.283920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.286372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad78e5-0f02-4935-bae3-3588332be7b0 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.291086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.291755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.292039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.292307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.293039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.294601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.304239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 791/1568] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:03.304964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.314382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ca040-7456-4e10-aa67-4278e576abea admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.318829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.319452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.319735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.320002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.320649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.322320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:28:03.322320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:28:03.322320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:28:03.323675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.367937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 778/1569] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.369438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.378732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b78bb-553c-4bcc-a26c-b9cc7c0af63a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.383335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.383908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.384987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.385450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.386128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.388040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.426182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 792/1570] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.426954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.460647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 779/1571] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.461447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.491478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a39558-41dc-42b7-9a99-4c0cfc545ea6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.523890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f30a-eb37-4dcd-8ee0-82dd71874161 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.529283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.529942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.530227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.530504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.531310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.533392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.549473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.550135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.550432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.550710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.551424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.553353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.614871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 780/1572] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.615899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.644693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 793/1573] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.647779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.678164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ccbb4-4a22-412d-a795-c06eb7b2aa2f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.706487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc3e7-2a1d-4315-bd38-a475c8eb9764 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.711207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.711892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.712772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.713096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.713813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.715769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.732792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.733437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.733722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.734004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.734688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.736610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.838155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 794/1574] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.839031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.874972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 781/1575] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:03.874972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.904033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6433cf-fbdc-4dea-805b-cdd1c2ba77d8 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.932516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68030b1-47d4-4df2-833c-dce4e1c22563 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.937325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.937988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.938274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.938552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.939373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.940983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.951427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 782/1576] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:03.952206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:03.959587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.960474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.960756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.961028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] PATH_INFO: `/v3/projects/d6bf32070ece442e8398d513f998a642/users/46720d2cfd88476fbcf2d1a456163042/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.961412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ff571-5c35-4e04-83e5-ac7b9a1466a3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:03.966539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:03.967173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:03.967487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:03.967766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:03.968439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.970345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:03.975826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bf32070ece442e8398d513f998a642, user_id=46720d2cfd88476fbcf2d1a456163042, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:03.976853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:28:03.976853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:28:03.976853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:28:03.978867 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.076915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 783/1577] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:03 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:04.077876 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.087789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83b461-7b87-4490-9372-0e35a9d06c87 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.091635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 795/1578] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:03 2022] PUT /identity/v3/projects/d6bf32070ece442e8398d513f998a642/users/46720d2cfd88476fbcf2d1a456163042/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:04.091635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.145511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.146187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.146473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.146754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.147476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.149458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.152999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e9210-3183-4e04-81c4-9272e9b6ab0c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.157588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.158250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.158529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.158800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.165046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.165046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.287678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 784/1579] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:04.288569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.298143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71ae63-4dff-42a0-a137-ab7ff73e543b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.299667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 796/1580] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:04.300417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.303115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.303906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.304189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.304465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.305140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.307731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.310655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7546db3-86d9-4a1e-9d72-91eba199fdf4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.315286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.319760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.319760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.319760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.319760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.319760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.408142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 785/1581] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:04.409100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.419572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cda3a-0fb6-4511-b310-8e732019dd5f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.424456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.425110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.425409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.425740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.426442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.428426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.430336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 797/1582] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:04.431827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.441383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38fde-6664-468e-a322-93ec579afcbb admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.445803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.446544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.446870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.447145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.448016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.449591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.459914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 798/1583] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.463170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.469784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4487b-9cc4-4af6-8fed-668086fc9ce2 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.474495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07aa1fd-9b2d-4192-83f4-b23b898d7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.475097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aa1fd-9b2d-4192-83f4-b23b898d7543 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.475450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aa1fd-9b2d-4192-83f4-b23b898d7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.475707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07aa1fd-9b2d-4192-83f4-b23b898d7543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.476381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aa1fd-9b2d-4192-83f4-b23b898d7543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.478385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07aa1fd-9b2d-4192-83f4-b23b898d7543 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.492832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 799/1584] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.492832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.492832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.492832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.517290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] MFA Rules not processed for user `46720d2cfd88476fbcf2d1a456163042`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:04.519475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 786/1585] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:04.519475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.519674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:04.528565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3347c-79b6-43e2-8d80-3946b354ecbd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.533410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.534062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.534350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.534633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.535377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.537059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.548347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 787/1586] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.550258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.562148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1245e-ed94-4bca-8fb3-b0e07d917dbc admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.566879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.567753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.567887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.568121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.568839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.570423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.580505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 788/1587] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.581306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.587199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 800/1588] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:04.588282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.591244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484f5d6-e2d8-49da-b8de-54b0b4982bba admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.598724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f918-cd89-4b00-9e57-fdf4c68b518d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.599693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.600348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.600635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.600923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.601680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.603807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.604243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.604907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.605238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.605458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.606189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.607814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.614463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 789/1589] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.623628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.623773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 801/1590] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.623773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.625811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d5c3-6888-471e-aa7d-0d65afdb8984 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.628774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8eff6-7a6a-4fb3-b675-dd1864e6f7f4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.630497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac9ae-fe85-4987-97b9-c65c61f6dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.631420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac9ae-fe85-4987-97b9-c65c61f6dc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.631700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac9ae-fe85-4987-97b9-c65c61f6dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.631971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac9ae-fe85-4987-97b9-c65c61f6dc80 admin admin] PATH_INFO: `/v3/projects/394ead9152f741e68d0eac3d52df3bc1/users/b6e168c909c64a48bcc2762081ed0658/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.633369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.634082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.634366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.634645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.635515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.637104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.647086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 802/1591] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.647827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac9ae-fe85-4987-97b9-c65c61f6dc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394ead9152f741e68d0eac3d52df3bc1, user_id=b6e168c909c64a48bcc2762081ed0658, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.647956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.650593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac9ae-fe85-4987-97b9-c65c61f6dc80 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.657442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129bf8c-569b-4772-9061-899b1defc004 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.662017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.662649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.662981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.663238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.664002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.666103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.676261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 803/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.677023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.687280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168aa81-8a44-4f65-b31b-bb65950dde79 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.693921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.693921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.693921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.693921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.694344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.695664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.705645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 804/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.706549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.715868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cd48e-da69-4db5-a32b-92c797d7d2ae admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.720466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.721077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.721379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.721634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.722579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.724151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.727428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 790/1594] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:04 2022] PUT /identity/v3/projects/394ead9152f741e68d0eac3d52df3bc1/users/b6e168c909c64a48bcc2762081ed0658/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:04.729343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7becc-b6d7-4828-b189-aa2c0db4828c None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.729630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7becc-b6d7-4828-b189-aa2c0db4828c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.729904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7becc-b6d7-4828-b189-aa2c0db4828c None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.731163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 791/1595] 10.222.0.42 () {54 vars in 960 bytes} [Tue May 3 16:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:04.731925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7becc-b6d7-4828-b189-aa2c0db4828c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.739005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 805/1596] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.739983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.750627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a5bd4-a10d-4891-b18b-d6af098c5c1b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.798148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7becc-b6d7-4828-b189-aa2c0db4828c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.802546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.803198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.803510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.803783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.804531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.805005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.805666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.806057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.806286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.806391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.807001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.808627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.816550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 792/1597] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.817480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.818541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 806/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.819217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.828534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dafcd-7780-48a7-969a-bc41f6e79b90 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.829904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74aee-793b-4c32-9345-2fb411831fe3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.833066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.833703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.833987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.834263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.834387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf22728-b431-4ea4-971b-ba645e332cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.834975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.835228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22728-b431-4ea4-971b-ba645e332cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.835533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22728-b431-4ea4-971b-ba645e332cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.835806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22728-b431-4ea4-971b-ba645e332cde admin admin] PATH_INFO: `/v3/projects/89299153896a4cd09bfb766b0f968ff2/users/17d1daa2f8954bb38c0220173a2432cd/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.836569 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.846976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 807/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:04.846976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:04.854711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf22728-b431-4ea4-971b-ba645e332cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=89299153896a4cd09bfb766b0f968ff2, user_id=17d1daa2f8954bb38c0220173a2432cd, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.857360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf22728-b431-4ea4-971b-ba645e332cde admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.859884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dcf34-0e32-4906-9669-658489f4ac10 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:04.864591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd2357-fd23-4dcc-a9d6-db42bf108eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:04.865444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd2357-fd23-4dcc-a9d6-db42bf108eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.865727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd2357-fd23-4dcc-a9d6-db42bf108eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.866000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd2357-fd23-4dcc-a9d6-db42bf108eb3 admin admin] PATH_INFO: `/v3/projects/f4895b42d548475090476b1fce29ee49/users/d8d24ae692ff44d59d0d8ce4c5a480ce/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.880306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd2357-fd23-4dcc-a9d6-db42bf108eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4895b42d548475090476b1fce29ee49, user_id=d8d24ae692ff44d59d0d8ce4c5a480ce, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:04.883004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd2357-fd23-4dcc-a9d6-db42bf108eb3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:04.980145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 793/1600] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:04 2022] PUT /identity/v3/projects/89299153896a4cd09bfb766b0f968ff2/users/17d1daa2f8954bb38c0220173a2432cd/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:04.989883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.989883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.989883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.991450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 808/1601] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:04 2022] PUT /identity/v3/projects/f4895b42d548475090476b1fce29ee49/users/d8d24ae692ff44d59d0d8ce4c5a480ce/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:04.992963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:04.993741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:04.993741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:04.998930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.000202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.011197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.012549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.057480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 794/1602] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.058113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.067016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7884a-fe38-4d91-a0fd-f57bf0c27da1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.071831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.072761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.073188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.073466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] PATH_INFO: `/v3/projects/6f272be1938043fab0bd96cad1e95e7e/users/bc1eb5755b1549e0b50c6f6a701a0d1c/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.081304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 809/1603] 10.222.0.42 () {58 vars in 1057 bytes} [Tue May 3 16:28:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.082249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.088394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f272be1938043fab0bd96cad1e95e7e, user_id=bc1eb5755b1549e0b50c6f6a701a0d1c, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.091201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.092924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b749c-df90-45ef-8009-597c2aa318c0 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.097906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.098779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.099062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.099376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] PATH_INFO: `/v3/projects/7a0fdcef1aea493eb403b185fe2f0b1f/users/09e4ecf500bf483b915097aae5f2ee7a/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.114812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0fdcef1aea493eb403b185fe2f0b1f, user_id=09e4ecf500bf483b915097aae5f2ee7a, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.117468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.160981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 795/1604] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:05 2022] PUT /identity/v3/projects/6f272be1938043fab0bd96cad1e95e7e/users/bc1eb5755b1549e0b50c6f6a701a0d1c/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:05.161792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.190702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 810/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:05 2022] PUT /identity/v3/projects/7a0fdcef1aea493eb403b185fe2f0b1f/users/09e4ecf500bf483b915097aae5f2ee7a/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:05.191646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.225171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6363-bda1-494f-b7b4-d47bec6a0023 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.260220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7b5f8-81dc-4589-a832-67ee3c812717 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.264991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6447d89-a714-4768-9df6-6b16638bc06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.265903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447d89-a714-4768-9df6-6b16638bc06a admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.266190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447d89-a714-4768-9df6-6b16638bc06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.266462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447d89-a714-4768-9df6-6b16638bc06a admin admin] PATH_INFO: `/v3/projects/58105e939ccc4750a9676302a6c0eeed/users/5dbb99a2a22e4c94828576fdc8aee066/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.282351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6447d89-a714-4768-9df6-6b16638bc06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58105e939ccc4750a9676302a6c0eeed, user_id=5dbb99a2a22e4c94828576fdc8aee066, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.284399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723a4cc-6c93-44e5-be66-15f39e391b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.285039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6447d89-a714-4768-9df6-6b16638bc06a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.285290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a4cc-6c93-44e5-be66-15f39e391b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.285571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a4cc-6c93-44e5-be66-15f39e391b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.285844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a4cc-6c93-44e5-be66-15f39e391b0b admin admin] PATH_INFO: `/v3/projects/9dfbe8d199574957aa9d6cab58de8df4/users/7a9a8cb8618742b59e174603160d9146/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.300226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723a4cc-6c93-44e5-be66-15f39e391b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfbe8d199574957aa9d6cab58de8df4, user_id=7a9a8cb8618742b59e174603160d9146, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.302844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723a4cc-6c93-44e5-be66-15f39e391b0b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.350457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 811/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:05 2022] PUT /identity/v3/projects/58105e939ccc4750a9676302a6c0eeed/users/5dbb99a2a22e4c94828576fdc8aee066/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:05.351801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.352088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.352359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.367682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 796/1607] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:05 2022] PUT /identity/v3/projects/9dfbe8d199574957aa9d6cab58de8df4/users/7a9a8cb8618742b59e174603160d9146/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:05.369432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.369785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.372386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.378725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] MFA Rules not processed for user `17d1daa2f8954bb38c0220173a2432cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.380003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.398087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] MFA Rules not processed for user `d8d24ae692ff44d59d0d8ce4c5a480ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.399322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.443927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 812/1608] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.444879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.463631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 797/1609] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.464562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.500719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5529de-72ac-40eb-8196-62d27878e99b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.505585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240a3c5-4d61-4081-b79f-6ddc1018398b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.506230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240a3c5-4d61-4081-b79f-6ddc1018398b service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.506512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240a3c5-4d61-4081-b79f-6ddc1018398b service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.506788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240a3c5-4d61-4081-b79f-6ddc1018398b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.536034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617337-82e9-4d55-ad53-4c15165276fa None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.541636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480e3b6-c1c6-49e8-8025-e41a359dba27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.542278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480e3b6-c1c6-49e8-8025-e41a359dba27 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.542559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480e3b6-c1c6-49e8-8025-e41a359dba27 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.542835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480e3b6-c1c6-49e8-8025-e41a359dba27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.567413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240a3c5-4d61-4081-b79f-6ddc1018398b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.569015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240a3c5-4d61-4081-b79f-6ddc1018398b service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.578938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 813/1610] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:05.580253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d825e7-5c50-41ca-94d3-9a6b69e4cd04 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.580527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d825e7-5c50-41ca-94d3-9a6b69e4cd04 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.580807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d825e7-5c50-41ca-94d3-9a6b69e4cd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.598482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-01d825e7-5c50-41ca-94d3-9a6b69e4cd04 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.599748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-01d825e7-5c50-41ca-94d3-9a6b69e4cd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.599906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480e3b6-c1c6-49e8-8025-e41a359dba27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.601351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480e3b6-c1c6-49e8-8025-e41a359dba27 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.608314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 814/1611] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.609614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.609904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.610181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.614035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 798/1612] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:05.615215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a8ca-cf0e-41bb-b06e-f7e6b26ca034 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.617335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a8ca-cf0e-41bb-b06e-f7e6b26ca034 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.617335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a8ca-cf0e-41bb-b06e-f7e6b26ca034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.633958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cc62a8ca-cf0e-41bb-b06e-f7e6b26ca034 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.636220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cc62a8ca-cf0e-41bb-b06e-f7e6b26ca034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.642654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] MFA Rules not processed for user `09e4ecf500bf483b915097aae5f2ee7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.643887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.645040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 799/1613] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.648441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34fd87-a9ba-4234-bd3e-a7a9fb20e66b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.648441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34fd87-a9ba-4234-bd3e-a7a9fb20e66b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.648441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34fd87-a9ba-4234-bd3e-a7a9fb20e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.686859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5b34fd87-a9ba-4234-bd3e-a7a9fb20e66b None None] MFA Rules not processed for user `7a9a8cb8618742b59e174603160d9146`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.691851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5b34fd87-a9ba-4234-bd3e-a7a9fb20e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.740319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 815/1614] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.741722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.754399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0671fd4-d0de-43e3-ada1-3c7b8e5395e9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.760586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840cd1e-dd29-4455-ae17-a274c38eecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.761663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840cd1e-dd29-4455-ae17-a274c38eecd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.762138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840cd1e-dd29-4455-ae17-a274c38eecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.762629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840cd1e-dd29-4455-ae17-a274c38eecd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.763652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840cd1e-dd29-4455-ae17-a274c38eecd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.766181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840cd1e-dd29-4455-ae17-a274c38eecd7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.777557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 800/1615] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:05.778950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6e10-b7b1-4187-b0fe-a156dcc6c5bf None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.779245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6e10-b7b1-4187-b0fe-a156dcc6c5bf None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.779592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6e10-b7b1-4187-b0fe-a156dcc6c5bf None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.781164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 801/1616] 10.222.0.42 () {54 vars in 960 bytes} [Tue May 3 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:05.782272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6e10-b7b1-4187-b0fe-a156dcc6c5bf None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.793881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6e10-b7b1-4187-b0fe-a156dcc6c5bf None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.797600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.798229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.798539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.798815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.808273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.809713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.818923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 802/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:05.819814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.827829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64861-967e-4407-8b0a-158daf2ad0b1 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.831707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.832334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.832615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.832890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.845213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.846679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:05.858729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 803/1618] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:05.864037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:05.872909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 816/1619] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:05.874294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dfd8-1b46-419b-b8c6-ebeab17f6ac7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.875039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dfd8-1b46-419b-b8c6-ebeab17f6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.875039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dfd8-1b46-419b-b8c6-ebeab17f6ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.883135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a83328-2b77-412d-bffe-5ba59f6ba312 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:05.905096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b438dfd8-1b46-419b-b8c6-ebeab17f6ac7 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:05.906393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b438dfd8-1b46-419b-b8c6-ebeab17f6ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:05.954656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:05.955504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:05.962003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:05.962003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:05.962003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:05.962003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.000915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 817/1620] 10.222.0.42 () {58 vars in 1057 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:06.002658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ac47-ce3c-42f1-a2f9-4767dda1b18b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.003098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ac47-ce3c-42f1-a2f9-4767dda1b18b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.003475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ac47-ce3c-42f1-a2f9-4767dda1b18b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.005877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 818/1621] 10.222.0.42 () {54 vars in 912 bytes} [Tue May 3 16:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:06.006729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ac47-ce3c-42f1-a2f9-4767dda1b18b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.022801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ac47-ce3c-42f1-a2f9-4767dda1b18b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.028703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af27aa-67e0-433f-a600-fa22e177c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.029646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af27aa-67e0-433f-a600-fa22e177c052 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.029779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af27aa-67e0-433f-a600-fa22e177c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.030115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af27aa-67e0-433f-a600-fa22e177c052 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.031221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af27aa-67e0-433f-a600-fa22e177c052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.033050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af27aa-67e0-433f-a600-fa22e177c052 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.069159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 804/1622] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:05 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:06.069159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.138067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440053fc-7e4d-46a1-8115-86ae9ffcb03b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.143829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.144687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.144825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.145032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.167760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 819/1623] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:06 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:06.169492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.169910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.170193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.212056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:06.213327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:06.239420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.239695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 820/1624] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:06.242510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.248480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.264583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 805/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:06.265653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.375192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a6687-92ff-41ed-9602-aaf6b4a2be64 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.381137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.382257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.382690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.383081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.384517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.385365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26e7d-2e8e-4fa6-96ef-3741fa032734 service nova] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.387685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.392435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.393107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.393455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.393741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.394537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.396483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.416512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 806/1626] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:06.416512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.510778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 821/1627] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:06 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:06.510778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.521360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156ecb-3973-4fd3-b5ba-b5ea6f0aaf3a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.535670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba0eb7-7c8f-48d7-b882-af6d6b768480 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.537392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.538028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.538312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.538588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.545078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.546368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.546885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.547399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] PATH_INFO: `/v3/projects/07dc88ec7e3542259a7290cc76c68f73/users/39e63ed7e0cb400aa7c8462f9d8480a6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.558392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.560231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.569683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dc88ec7e3542259a7290cc76c68f73, user_id=39e63ed7e0cb400aa7c8462f9d8480a6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.575932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.592340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 807/1628] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:06.593947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.618729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337856-0878-4d4e-82c9-f5f5f46e9557 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.625795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.630623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.630623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.630623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.630623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.630623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.663977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 808/1629] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:06.666425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.684454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 822/1630] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:06 2022] PUT /identity/v3/projects/07dc88ec7e3542259a7290cc76c68f73/users/39e63ed7e0cb400aa7c8462f9d8480a6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:06.685790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.714764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dda33c-11fa-414c-ae70-d3538f857269 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.786337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c5a35-264a-4895-af7e-47e468419ff8 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:06.792619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.794407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.794819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.795323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] PATH_INFO: `/v3/projects/62ceb84688ec488685bbd929d63bf4db/users/2cdfadc42afa4d80b866d13c8e9d3533/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.824086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:06.824936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:06.825781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:06.826078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:06.826702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ceb84688ec488685bbd929d63bf4db, user_id=2cdfadc42afa4d80b866d13c8e9d3533, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.830326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.902896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:06.904854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:06.916272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 809/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:06.928671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 823/1632] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:06 2022] PUT /identity/v3/projects/62ceb84688ec488685bbd929d63bf4db/users/2cdfadc42afa4d80b866d13c8e9d3533/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:06.933454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.940435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:06.972426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2846-90aa-4d12-903f-6966451d7cde service nova] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.034136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7861ac5-ab0a-4fb8-a0e9-29160a62f4cc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.042894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb5060-a5cd-48ae-8e89-211afb4be6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.043543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb5060-a5cd-48ae-8e89-211afb4be6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.043966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb5060-a5cd-48ae-8e89-211afb4be6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.044250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb5060-a5cd-48ae-8e89-211afb4be6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.045309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb5060-a5cd-48ae-8e89-211afb4be6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.047405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb5060-a5cd-48ae-8e89-211afb4be6f0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.066691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 824/1633] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:28:07.068549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135c45-4ac9-4efd-b762-696aa0359e5b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.069853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135c45-4ac9-4efd-b762-696aa0359e5b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.070200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad135c45-4ac9-4efd-b762-696aa0359e5b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.074139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 825/1634] 10.222.0.42 () {54 vars in 912 bytes} [Tue May 3 16:28:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:07.074313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9b2a5-fdbc-4031-9790-5e9f30f5e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.074985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b2a5-fdbc-4031-9790-5e9f30f5e3af admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.075113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135c45-4ac9-4efd-b762-696aa0359e5b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:07.076175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b2a5-fdbc-4031-9790-5e9f30f5e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.076473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9b2a5-fdbc-4031-9790-5e9f30f5e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.077224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9b2a5-fdbc-4031-9790-5e9f30f5e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.079023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9b2a5-fdbc-4031-9790-5e9f30f5e3af admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.091680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 810/1635] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:07.093319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d2cb7-c8d4-49aa-9ee3-0d909514d6be None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.093614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d2cb7-c8d4-49aa-9ee3-0d909514d6be None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.093897 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d2cb7-c8d4-49aa-9ee3-0d909514d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.096047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad135c45-4ac9-4efd-b762-696aa0359e5b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.103736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.107613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.107956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.115703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] PATH_INFO: `/v3/projects/62ceb84688ec488685bbd929d63bf4db/users/2cdfadc42afa4d80b866d13c8e9d3533/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.115703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ceb84688ec488685bbd929d63bf4db, user_id=2cdfadc42afa4d80b866d13c8e9d3533, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.116339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-937d2cb7-c8d4-49aa-9ee3-0d909514d6be None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:07.116790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.117609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-937d2cb7-c8d4-49aa-9ee3-0d909514d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:07.134841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 826/1636] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:07 2022] PUT /identity/v3/projects/62ceb84688ec488685bbd929d63bf4db/users/2cdfadc42afa4d80b866d13c8e9d3533/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:07.136026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:07.220768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 811/1637] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:07.222353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bfaf0-eb59-4079-b6c9-d168a5e284af None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.222719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bfaf0-eb59-4079-b6c9-d168a5e284af None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.223084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bfaf0-eb59-4079-b6c9-d168a5e284af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.231292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb468a5-f754-44d9-a4dd-be575c97cf0b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.236334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.237374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.237850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.238198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] PATH_INFO: `/v3/projects/07dc88ec7e3542259a7290cc76c68f73/users/39e63ed7e0cb400aa7c8462f9d8480a6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.240368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dc88ec7e3542259a7290cc76c68f73, user_id=39e63ed7e0cb400aa7c8462f9d8480a6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.256759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.263180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-806bfaf0-eb59-4079-b6c9-d168a5e284af None None] MFA Rules not processed for user `2cdfadc42afa4d80b866d13c8e9d3533`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:07.264567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-806bfaf0-eb59-4079-b6c9-d168a5e284af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:07.281920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 827/1638] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:07 2022] PUT /identity/v3/projects/07dc88ec7e3542259a7290cc76c68f73/users/39e63ed7e0cb400aa7c8462f9d8480a6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:07.284093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:07.378834 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 812/1639] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:07.380043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce04cf-fd20-456e-8a4c-e1dfefe6a13b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.380345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce04cf-fd20-456e-8a4c-e1dfefe6a13b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.380619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce04cf-fd20-456e-8a4c-e1dfefe6a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.396883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2952bc-3f65-47db-a0d2-2170840b51fe admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.400616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1773-2685-4e60-b66f-ee38a15aeaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.401217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1773-2685-4e60-b66f-ee38a15aeaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.401497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1773-2685-4e60-b66f-ee38a15aeaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.401820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1773-2685-4e60-b66f-ee38a15aeaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.412361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-abce04cf-fd20-456e-8a4c-e1dfefe6a13b None None] MFA Rules not processed for user `39e63ed7e0cb400aa7c8462f9d8480a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:07.413947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-abce04cf-fd20-456e-8a4c-e1dfefe6a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:07.544155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac1773-2685-4e60-b66f-ee38a15aeaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.546201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac1773-2685-4e60-b66f-ee38a15aeaa4 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.558523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 828/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:07.559950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.560243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.565657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.586555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 813/1641] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:07.601555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] MFA Rules not processed for user `5dbb99a2a22e4c94828576fdc8aee066`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:07.601555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:07.677909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 829/1642] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:07.692789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.693470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.693936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.724827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:07.740079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] MFA Rules not processed for user `5dbb99a2a22e4c94828576fdc8aee066`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:07.741526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:07.744259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b349-c244-4739-9ab4-b5b23d49cff8 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.750874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.751591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 814/1643] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:07.752933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.753478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.754368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.843064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.844929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.874462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 830/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:28:07.926838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:07.943068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc59fc-cecc-4be4-8101-da24a80e0e1d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:07.948665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:07.949420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:07.949705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:07.950007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:07.963041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:07.964872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:07.978424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 815/1645] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:08.229328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:08.253375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14383-813e-47bd-9631-31cef895f639 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:08.270142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa21781-9db0-410d-97ae-4a10a664c2fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:08.272332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21781-9db0-410d-97ae-4a10a664c2fd service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:08.272626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21781-9db0-410d-97ae-4a10a664c2fd service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:08.272906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21781-9db0-410d-97ae-4a10a664c2fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:08.291897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa21781-9db0-410d-97ae-4a10a664c2fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:08.295082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa21781-9db0-410d-97ae-4a10a664c2fd service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:08.307748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 831/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:08.487026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:08.505190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39ba4-197b-476e-926f-9df5d0a05686 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:08.515111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1ed78-5acd-4266-93e4-b025f7b3ac39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:08.729500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1ed78-5acd-4266-93e4-b025f7b3ac39 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:08.729500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1ed78-5acd-4266-93e4-b025f7b3ac39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:08.729500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1ed78-5acd-4266-93e4-b025f7b3ac39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:08.729500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1ed78-5acd-4266-93e4-b025f7b3ac39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:08.729500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1ed78-5acd-4266-93e4-b025f7b3ac39 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:08.729500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 816/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:08.915965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738155e6-62fb-43c2-93f1-c063ec0e136b None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:08.916560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738155e6-62fb-43c2-93f1-c063ec0e136b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:08.916931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738155e6-62fb-43c2-93f1-c063ec0e136b None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:08.920300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 832/1648] 10.222.0.42 () {54 vars in 912 bytes} [Tue May 3 16:28:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:08.929318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:08.929611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:08.929887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:08.974047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:08.975361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:09.048197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 817/1649] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:09.061940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738155e6-62fb-43c2-93f1-c063ec0e136b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:09.074589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738155e6-62fb-43c2-93f1-c063ec0e136b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:09.079540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:09.080055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:09.080335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:09.080613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:09.088951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:09.090628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:09.100405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 833/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:09.832877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:09.854654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511df39-ce15-4ff9-8b42-420eb973a510 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:09.865124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdfadc42afa4d80b866d13c8e9d3533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ceb84688ec488685bbd929d63bf4db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:09.865841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:09.866128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:09.866412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:09.867139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:09.867479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:09.869210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4556-e15c-45d9-99bf-51e4fa37ed78 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:09.888384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 818/1651] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:09.892637 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:09.906873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03031-b122-43bd-9cf1-9f420c877126 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:09.907087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03031-b122-43bd-9cf1-9f420c877126 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:09.908426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03031-b122-43bd-9cf1-9f420c877126 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:09.909673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c9d94-5106-4b85-89c1-b0dcb84b508c service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:09.912132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 819/1652] 10.222.0.42 () {54 vars in 960 bytes} [Tue May 3 16:28:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:09.917596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdfadc42afa4d80b866d13c8e9d3533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ceb84688ec488685bbd929d63bf4db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:09.918936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:09.918936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:09.918936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:09.919564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:09.922104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:09.922250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:09.922442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:09.923076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:09.971243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] MFA Rules not processed for user `16fc7e5d900a487d83be32cd8c2ffbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:09.973964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:10.061020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 820/1653] 10.222.0.42 () {58 vars in 1057 bytes} [Tue May 3 16:28:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:10.069798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:10.093071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdcc9f-2ec4-4265-b7be-8fce103afe65 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:10.094187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 834/1654] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:09 2022] POST /identity/v3/projects => generated 353 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:10.095686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:10.175456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004462-d940-4111-af28-669d9d0c3a82 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:10.183292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:10.187418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:10.187418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:10.187418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] PATH_INFO: `/v3/users/d8d24ae692ff44d59d0d8ce4c5a480ce` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:10.187418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d24ae692ff44d59d0d8ce4c5a480ce)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:10.187922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: WARNING py.warnings [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:28:10.187922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: warnings.warn(msg) May 03 16:28:10.187922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: May 03 16:28:10.189132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:10.204048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:10.204735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:10.205041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:10.205324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:10.207185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:10.219957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:10.221601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:10.234735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 821/1655] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:10.235880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:10.324684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978804-a0bf-4c08-8725-abd8d2043dc6 service placement] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:10.335905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdfadc42afa4d80b866d13c8e9d3533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ceb84688ec488685bbd929d63bf4db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:10.336775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:10.337944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:10.338198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:10.339679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:10.339679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:10.341752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:10.358463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 822/1656] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:10.404169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d24ae692ff44d59d0d8ce4c5a480ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.411862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:10.429349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907f42e-8580-4c10-ae3d-3b5c3141f46b tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:10.448972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cdfadc42afa4d80b866d13c8e9d3533', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62ceb84688ec488685bbd929d63bf4db', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:10.449866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:10.451906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:10.451906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] PATH_INFO: `/v3/projects/5a25049e831644239d3cb468350290b7` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:10.453745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a25049e831644239d3cb468350290b7)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:10.455161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: WARNING py.warnings [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 16:28:10.455161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: warnings.warn(msg) May 03 16:28:10.455161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: May 03 16:28:10.456542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:10.458726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d24ae692ff44d59d0d8ce4c5a480ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.462224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d24ae692ff44d59d0d8ce4c5a480ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.462877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d24ae692ff44d59d0d8ce4c5a480ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.757936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8bf016f4-cda1-4339-b51d-0b58997a2c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d24ae692ff44d59d0d8ce4c5a480ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.757936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 835/1657] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:10 2022] DELETE /identity/v3/users/d8d24ae692ff44d59d0d8ce4c5a480ce => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:10.757936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:10.757936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:10.757936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:10.757936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:10.765105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a25049e831644239d3cb468350290b7', 'request_id': 'req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.769507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:10.772889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a25049e831644239d3cb468350290b7', 'request_id': 'req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.772889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a25049e831644239d3cb468350290b7', 'request_id': 'req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.850490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 836/1658] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:10.861458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:10.863231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:10.939318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] The token cache is being invalidate because project 5a25049e831644239d3cb468350290b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:10.939871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.941644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:10.944879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 823/1659] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:10 2022] DELETE /identity/v3/projects/5a25049e831644239d3cb468350290b7 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:10.972847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a86b8-9d25-48bd-958c-7390a6caf308 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:10.976781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:10.977546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:10.978050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:10.979879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:10.981847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:11.060831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:11.067088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:11.080008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 837/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:11.523667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:11.525488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:11.550857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f624-67c4-4ed5-ae97-d3cd18ad8ad5 tempest-VolumeQuotaClassesTest-763676875 tempest-VolumeQuotaClassesTest-763676875-project-admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:11.562989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:11.565797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:11.566447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:11.566882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] PATH_INFO: `/v3/users/46720d2cfd88476fbcf2d1a456163042` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:11.573919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46720d2cfd88476fbcf2d1a456163042)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:11.576496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:11.850221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46720d2cfd88476fbcf2d1a456163042'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:11.867093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46720d2cfd88476fbcf2d1a456163042'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:11.869261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46720d2cfd88476fbcf2d1a456163042'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:11.872142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46720d2cfd88476fbcf2d1a456163042'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:11.904830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96faf9b4-5cb9-4c7e-9774-dd16b1fcda47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46720d2cfd88476fbcf2d1a456163042'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.023707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:12.025504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:12.049104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af1c5-16ee-497b-ac3c-442960e42930 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:12.054958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 824/1661] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:11 2022] DELETE /identity/v3/users/46720d2cfd88476fbcf2d1a456163042 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:12.060219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.060534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.060811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.075888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:12.076855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.077200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.077482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] PATH_INFO: `/v3/projects/f4895b42d548475090476b1fce29ee49` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.079021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4895b42d548475090476b1fce29ee49)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:12.085987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:12.090941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:12.093307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:12.299126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 825/1662] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:12.306605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:12.308565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:12.356382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4895b42d548475090476b1fce29ee49', 'request_id': 'req-c8cc3920-0cd2-40fc-9f98-dc753126e29f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.436656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a2e4-393a-42ad-b436-500b6c3304c9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:12.515642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b4221-2d3b-4abe-bb86-e3791f5ef210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:12.516429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4221-2d3b-4abe-bb86-e3791f5ef210 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.517042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4221-2d3b-4abe-bb86-e3791f5ef210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.517244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b4221-2d3b-4abe-bb86-e3791f5ef210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.542762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4895b42d548475090476b1fce29ee49', 'request_id': 'req-c8cc3920-0cd2-40fc-9f98-dc753126e29f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.542762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4895b42d548475090476b1fce29ee49', 'request_id': 'req-c8cc3920-0cd2-40fc-9f98-dc753126e29f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.570586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] The token cache is being invalidate because project f4895b42d548475090476b1fce29ee49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:12.572190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.573328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.575670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 838/1663] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:12 2022] DELETE /identity/v3/projects/f4895b42d548475090476b1fce29ee49 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:12.576657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:12.580561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:12.657888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4221-2d3b-4abe-bb86-e3791f5ef210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:12.659607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b4221-2d3b-4abe-bb86-e3791f5ef210 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:12.696551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc3920-0cd2-40fc-9f98-dc753126e29f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:12.699843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 826/1664] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:28:12.704021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:12.704168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a59b88-9c83-4c55-a494-8b62b04b20e5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.704691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a59b88-9c83-4c55-a494-8b62b04b20e5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.704987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a59b88-9c83-4c55-a494-8b62b04b20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.705720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.706206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.707302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] PATH_INFO: `/v3/users/09e4ecf500bf483b915097aae5f2ee7a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.708809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e4ecf500bf483b915097aae5f2ee7a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:12.711936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:12.755408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-50a59b88-9c83-4c55-a494-8b62b04b20e5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:12.758128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-50a59b88-9c83-4c55-a494-8b62b04b20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:12.784770 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 827/1665] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:12.787065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.787381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.787665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.816320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:12.818398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:12.837662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 828/1666] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:12.838889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:12.860087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435b453-e5a7-493f-bff8-783fcffd732a None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:12.865542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:12.867164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.867448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.867818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.871775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:12.872468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:12.874123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:12.888086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 829/1667] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:28:12.892414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:12.916254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4377187-00db-4cd3-a3f1-92d68e6030c9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:12.921688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:12.922433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:12.923186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:12.923595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:12.925068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:12.927548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:12.933931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e4ecf500bf483b915097aae5f2ee7a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.970558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e4ecf500bf483b915097aae5f2ee7a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.971501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e4ecf500bf483b915097aae5f2ee7a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:12.972856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e4ecf500bf483b915097aae5f2ee7a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.058105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 830/1668] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:12 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:13.061970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:13.066395 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:13.076694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7d5db0ae-eb89-4735-a17a-4fa3e3f8ade5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e4ecf500bf483b915097aae5f2ee7a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.111881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 839/1669] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:12 2022] DELETE /identity/v3/users/09e4ecf500bf483b915097aae5f2ee7a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:13.116801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.117332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.118981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.146720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:13.148462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:13.207011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2365fcb-db40-4ae8-bb1f-71d131ef91c6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:13.241066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 840/1670] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:13.270067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:13.272347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:13.334449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:13.339680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.339680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.339680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.339680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:13.343081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:13.372439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ff479-bcb9-466c-8a71-fc8627f339f3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:13.373148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:13.374106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.375171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.375711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.388423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:13.390320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:13.403904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 841/1671] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:13.405187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:13.407208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:13.425185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73554043-cd6d-4e5e-9083-1a663e3eef9c service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:13.442364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:13.443354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.443706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.444051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] PATH_INFO: `/v3/projects/d6bf32070ece442e8398d513f998a642` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.446118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bf32070ece442e8398d513f998a642)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:13.449436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:13.490687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 831/1672] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:13 2022] POST /identity/v3/users => generated 302 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:13.492145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:13.533275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fe7a1-f1bf-44ba-b47d-ec1e7145942a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:13.546179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:13.546598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.546884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.547157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.547914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:13.549578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:13.569768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 832/1673] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:13.572620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:13.597172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46ac16-3e4f-44ac-a6e3-3141247b7ae3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:13.606445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bf32070ece442e8398d513f998a642', 'request_id': 'req-9b62910c-c660-48df-ad8f-8b43459e08c7'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.751781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bf32070ece442e8398d513f998a642', 'request_id': 'req-9b62910c-c660-48df-ad8f-8b43459e08c7'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.770933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bf32070ece442e8398d513f998a642', 'request_id': 'req-9b62910c-c660-48df-ad8f-8b43459e08c7'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.800632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] The token cache is being invalidate because project d6bf32070ece442e8398d513f998a642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:13.800632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.809276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b62910c-c660-48df-ad8f-8b43459e08c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:13.819176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 842/1674] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:13 2022] DELETE /identity/v3/projects/d6bf32070ece442e8398d513f998a642 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:13.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8485-74d8-4361-aee3-78ae4f1072a3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8485-74d8-4361-aee3-78ae4f1072a3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.830135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8485-74d8-4361-aee3-78ae4f1072a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.860756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-db0a8485-74d8-4361-aee3-78ae4f1072a3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:13.862764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-db0a8485-74d8-4361-aee3-78ae4f1072a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:13.885761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:13.886690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.886690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.886849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.887727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:13.889567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:13.901836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 833/1675] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:28:13.906142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:13.908583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:13.924899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1a1e-4b2e-4305-a527-f4763e55b152 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:13.932302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e587273-374e-4ed3-a5d5-bd122cf11ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:13.934090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587273-374e-4ed3-a5d5-bd122cf11ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.934829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587273-374e-4ed3-a5d5-bd122cf11ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.935181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e587273-374e-4ed3-a5d5-bd122cf11ea7 admin admin] PATH_INFO: `/v3/projects/e839f234942d48419463e396c062b641/users/280b3585252d4783993c8735ae76f188/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.957277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 843/1676] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:13.958749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e587273-374e-4ed3-a5d5-bd122cf11ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e839f234942d48419463e396c062b641, user_id=280b3585252d4783993c8735ae76f188, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:13.961687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e587273-374e-4ed3-a5d5-bd122cf11ea7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:13.964962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:13.965467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:13.966457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:13.989736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:13.990595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:14.002774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 844/1677] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:14.007164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:14.029398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735995b-085e-4091-b750-fbef0cb21973 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:14.035437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:14.036237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:14.036615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:14.037007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:14.038118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:14.038491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:14.041166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:14.045166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 834/1678] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:13 2022] PUT /identity/v3/projects/e839f234942d48419463e396c062b641/users/280b3585252d4783993c8735ae76f188/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:14.059303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:14.060661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:14.060940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 845/1679] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:28:14.061424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:14.061864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:14.075747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322b009-1a99-45c7-aaa7-6387f7820650 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:14.149380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] MFA Rules not processed for user `280b3585252d4783993c8735ae76f188`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:14.154865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:14.255914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:14.260198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:14.260487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:14.260766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:14.263600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:14.271775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:14.300391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 835/1680] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:14.301569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:14.326614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f239949-7710-4824-ae1a-3cfdd5f710f8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:14.336508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:14.337217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:14.337608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:14.337982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:14.338778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:14.340997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:14.429762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 846/1681] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:14 2022] POST /identity/v3/projects => generated 355 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:14.431698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:14.467756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 836/1682] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:14 2022] POST /identity/v3/projects => generated 401 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:14.467756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:14.475492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:14.626053 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3670544-7257-4a11-b38d-a84b1aa6968e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:14.658964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f6623-4e9b-43ca-becc-b232b4141bfd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:14.669706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:14.673135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:14.675468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:14.675821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] PATH_INFO: `/v3/projects/7a0fdcef1aea493eb403b185fe2f0b1f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:14.677320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0fdcef1aea493eb403b185fe2f0b1f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:14.680357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:14.728525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:14.729134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:14.729425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:14.729706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:14.730412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:14.733280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:14.859689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 847/1683] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:14 2022] POST /identity/v3/users => generated 278 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:14.860895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:14.869209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0fdcef1aea493eb403b185fe2f0b1f', 'request_id': 'req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:14.880393 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0fdcef1aea493eb403b185fe2f0b1f', 'request_id': 'req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:14.886635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0491b2b-2962-4563-a9c3-c7835ff9245a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:14.905983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0fdcef1aea493eb403b185fe2f0b1f', 'request_id': 'req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:14.999530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.000595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.000595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.000835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.001544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.004219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.047092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] The token cache is being invalidate because project 7a0fdcef1aea493eb403b185fe2f0b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:15.047943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.048111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.052956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 837/1684] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:14 2022] DELETE /identity/v3/projects/7a0fdcef1aea493eb403b185fe2f0b1f => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:15.054478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.055741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:15.069210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0efbe-f95d-4fa7-94f1-f971537f0bfb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.074825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.075535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.075823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.081173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.081173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.081173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.098423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 838/1685] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:15.100522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.111599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:15.124697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 848/1686] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:14 2022] POST /identity/v3/users => generated 307 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:15.125786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.129486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760155e-9c69-4965-b1f1-f62645f1ca99 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.135218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.136166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.136480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.137193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] PATH_INFO: `/v3/users/2cdfadc42afa4d80b866d13c8e9d3533` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.138001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdfadc42afa4d80b866d13c8e9d3533)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.139981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.154761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13828a6-073b-45e0-b662-dbc1631685bc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.166029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.172525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.172525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.172525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.172525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.173285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.190431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 849/1687] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:15.194268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.206720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:15.237782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8aa9f-0b01-4fda-a86f-be227ff5e812 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.255246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.255246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.255509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.255839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.256605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.258239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.296047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 850/1688] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:15.296047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.315706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd48f-0e05-48e6-a8f7-6bc6bc048619 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.321458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.325486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.325486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.325486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] PATH_INFO: `/v3/projects/6635421862ac49548fbcb0108de808ee/users/b1c3afa1772f4153ad8dce026c992b3d/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.340504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6635421862ac49548fbcb0108de808ee, user_id=b1c3afa1772f4153ad8dce026c992b3d, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.343475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.399153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdfadc42afa4d80b866d13c8e9d3533'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.409210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdfadc42afa4d80b866d13c8e9d3533'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.410103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdfadc42afa4d80b866d13c8e9d3533'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.410771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdfadc42afa4d80b866d13c8e9d3533'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.433046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5705b3be-7e6c-4fd1-974c-d8a470d251db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdfadc42afa4d80b866d13c8e9d3533'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:15.485950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 851/1689] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:15 2022] PUT /identity/v3/projects/6635421862ac49548fbcb0108de808ee/users/b1c3afa1772f4153ad8dce026c992b3d/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:15.486934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.496599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:15.575025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 839/1690] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:15 2022] DELETE /identity/v3/users/2cdfadc42afa4d80b866d13c8e9d3533 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:15.577134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.577485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.578035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.632861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ccc20-7b89-4516-8805-40be3d87301a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.652536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] MFA Rules not processed for user `b1c3afa1772f4153ad8dce026c992b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:15.654629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:15.744533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 840/1691] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:15.751583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:15.754329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:15.832673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.834549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.837221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.839565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] PATH_INFO: `/v3/projects/7fc3db34cb704239871baaa586c1da56/users/fad5fd277a2d449dba07e87bb3ca1486/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.898523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc3db34cb704239871baaa586c1da56, user_id=fad5fd277a2d449dba07e87bb3ca1486, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.901883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.911839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c0404-d8ed-4186-89a6-1222abbe980d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:15.925792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:15.926484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:15.926767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:15.927041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:15.928491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:15.931793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:15.976049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 852/1692] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:15 2022] PUT /identity/v3/projects/7fc3db34cb704239871baaa586c1da56/users/fad5fd277a2d449dba07e87bb3ca1486/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:15.979985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.067232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 841/1693] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:15 2022] POST /identity/v3/projects => generated 357 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:16.071175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.176000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd6123-45f6-43cd-a693-d53e224ad014 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:16.246935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4dd5e-6985-4300-b4fe-862c405d2d29 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:16.253516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03155586-e555-43e9-bf91-1c757c273861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:16.254348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03155586-e555-43e9-bf91-1c757c273861 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.254634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03155586-e555-43e9-bf91-1c757c273861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.254907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03155586-e555-43e9-bf91-1c757c273861 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.256120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03155586-e555-43e9-bf91-1c757c273861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:16.259560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03155586-e555-43e9-bf91-1c757c273861 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:16.332077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:16.332836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.333135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.333404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.334143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:16.335818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:16.344630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 842/1694] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:16 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:16.344630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.344630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.344630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.368409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 853/1695] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:16.372880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.391199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826ab0-030e-4773-8df2-0f81f1d73a2a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:16.403638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:16.404333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.404688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.404969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.405709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:16.409973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:16.432589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 854/1696] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:16.435970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.437241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] MFA Rules not processed for user `b6e168c909c64a48bcc2762081ed0658`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:16.442143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:16.459231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ae1c-db1c-418b-a4d1-7d58353d7b22 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:16.469059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:16.470014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.470301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.470579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] PATH_INFO: `/v3/projects/7fc3db34cb704239871baaa586c1da56/users/fad5fd277a2d449dba07e87bb3ca1486/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.485603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc3db34cb704239871baaa586c1da56, user_id=fad5fd277a2d449dba07e87bb3ca1486, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:16.485603 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:16.511320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 855/1697] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:16 2022] PUT /identity/v3/projects/7fc3db34cb704239871baaa586c1da56/users/fad5fd277a2d449dba07e87bb3ca1486/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:16.519002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.524772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:16.601555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 843/1698] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:16.602502 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.617628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14599fa-678a-4ca7-b45e-400ad14d6dde None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:16.623410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4811f-e208-46da-91e2-1cf2eb7936c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:16.624396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4811f-e208-46da-91e2-1cf2eb7936c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.624746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4811f-e208-46da-91e2-1cf2eb7936c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.625095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4811f-e208-46da-91e2-1cf2eb7936c9 admin admin] PATH_INFO: `/v3/projects/e3918bc393af492bbfd0e584619dabe6/users/1f86bf21154f40aba107a8ce33821a50/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.628076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d155423-41dd-407e-bab7-5b0a9efacae3 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:16.632961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:16.634612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.635044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.635367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] PATH_INFO: `/v3/projects/62ceb84688ec488685bbd929d63bf4db` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.636596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ceb84688ec488685bbd929d63bf4db)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:16.638548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:16.646982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4811f-e208-46da-91e2-1cf2eb7936c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3918bc393af492bbfd0e584619dabe6, user_id=1f86bf21154f40aba107a8ce33821a50, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:16.646982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4811f-e208-46da-91e2-1cf2eb7936c9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:16.757507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 844/1699] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:16 2022] PUT /identity/v3/projects/e3918bc393af492bbfd0e584619dabe6/users/1f86bf21154f40aba107a8ce33821a50/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:16.760034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.760826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.760826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.783396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ceb84688ec488685bbd929d63bf4db', 'request_id': 'req-7212a633-9c38-41fb-b821-107a38be801e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:16.824074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] MFA Rules not processed for user `fad5fd277a2d449dba07e87bb3ca1486`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:16.826036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:16.871233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ceb84688ec488685bbd929d63bf4db', 'request_id': 'req-7212a633-9c38-41fb-b821-107a38be801e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:16.879602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ceb84688ec488685bbd929d63bf4db', 'request_id': 'req-7212a633-9c38-41fb-b821-107a38be801e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:16.918771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] The token cache is being invalidate because project 62ceb84688ec488685bbd929d63bf4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:16.920203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:16.922141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7212a633-9c38-41fb-b821-107a38be801e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:16.927200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 856/1700] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:16 2022] DELETE /identity/v3/projects/62ceb84688ec488685bbd929d63bf4db => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:16.928963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86911-c1f3-40f7-8114-ba7891a81725 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:16.929257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86911-c1f3-40f7-8114-ba7891a81725 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:16.929539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86911-c1f3-40f7-8114-ba7891a81725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:16.971205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 845/1701] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:16.972928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-54b86911-c1f3-40f7-8114-ba7891a81725 None None] MFA Rules not processed for user `b6e168c909c64a48bcc2762081ed0658`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:16.974577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:16.975510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-54b86911-c1f3-40f7-8114-ba7891a81725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:16.979043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.081667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 857/1702] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:17.083521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.083970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.084260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.103000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a3a5-c3bc-4464-b9c5-f705fde9d367 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:17.111801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:17.112272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:17.112479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.116589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.116589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.116763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.116835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:17.116835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:17.139011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 846/1703] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:17.139011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:17.140442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 858/1704] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:17.141474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:17.142874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.143594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.311528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a4b16-600d-4526-943f-09644edb9f3d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:17.315808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e7d3c-2eed-4ff6-859c-20120d2d2a87 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:17.330972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:17.332298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.333223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.333693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.334239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9a94e-feb8-4881-91cf-3a48f937cd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:17.336010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a94e-feb8-4881-91cf-3a48f937cd4b service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.337092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a94e-feb8-4881-91cf-3a48f937cd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.337812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.339924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a94e-feb8-4881-91cf-3a48f937cd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.370822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:17.373108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a94e-feb8-4881-91cf-3a48f937cd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:17.374134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:17.386930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a94e-feb8-4881-91cf-3a48f937cd4b service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:17.397300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 859/1705] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:17.398607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:17.418277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4c38-e43e-4562-9419-a4a01bdd34fd service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:17.418549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 847/1706] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:17.419935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.420232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.420507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.451522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e64a09-ff0f-4b6a-918c-3226ed4af388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:17.465042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64a09-ff0f-4b6a-918c-3226ed4af388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.465910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64a09-ff0f-4b6a-918c-3226ed4af388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.466976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e64a09-ff0f-4b6a-918c-3226ed4af388 admin admin] PATH_INFO: `/v3/projects/e3918bc393af492bbfd0e584619dabe6/users/1f86bf21154f40aba107a8ce33821a50/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.471848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e64a09-ff0f-4b6a-918c-3226ed4af388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3918bc393af492bbfd0e584619dabe6, user_id=1f86bf21154f40aba107a8ce33821a50, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:17.481800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:17.483039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.485384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e64a09-ff0f-4b6a-918c-3226ed4af388 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:17.529024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 848/1707] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:17.534809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:17.565869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 860/1708] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:17 2022] PUT /identity/v3/projects/e3918bc393af492bbfd0e584619dabe6/users/1f86bf21154f40aba107a8ce33821a50/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:17.569463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf39d-ad56-49b5-a964-512303cbf56f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:17.586024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566923-b887-489f-a24b-0920901eeffd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.586879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566923-b887-489f-a24b-0920901eeffd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.587155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566923-b887-489f-a24b-0920901eeffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.691341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-03566923-b887-489f-a24b-0920901eeffd None None] MFA Rules not processed for user `1f86bf21154f40aba107a8ce33821a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:17.692410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-03566923-b887-489f-a24b-0920901eeffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.755901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:17.756630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.756856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.757137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.757971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:17.758216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:17.764558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a521b-9652-46ac-87ba-e47653ecc606 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:17.786249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 849/1709] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:17.786249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.786249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.786249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.837913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] MFA Rules not processed for user `bc1eb5755b1549e0b50c6f6a701a0d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:17.839024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:17.927015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 861/1710] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:17.927015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566923-b887-489f-a24b-0920901eeffd None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:17.953162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566923-b887-489f-a24b-0920901eeffd None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:17.963180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:17.964421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:17.964922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:17.965201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:17.965911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:17.974673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:18.019366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 850/1711] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:18.019366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:18.027047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:18.042133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f314aab-d259-4119-84de-9e3e46b6ea22 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:18.047830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:18.048849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.049541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.049834 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] PATH_INFO: `/v3/users/280b3585252d4783993c8735ae76f188` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.051842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280b3585252d4783993c8735ae76f188)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:18.054568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:18.096420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 862/1712] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:17 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:18.097783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:18.205155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70139586-1328-4293-be2d-5d5d3f2a7a13 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:18.209343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:18.210114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.210453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.210792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.283827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280b3585252d4783993c8735ae76f188'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:18.297497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280b3585252d4783993c8735ae76f188'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:18.299719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280b3585252d4783993c8735ae76f188'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:18.300557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280b3585252d4783993c8735ae76f188'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:18.304410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:18.306154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:18.334008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 863/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:18.335062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:18.338572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:18.345343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-70678bf9-fefa-4d0f-a97e-7b3f231f9b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280b3585252d4783993c8735ae76f188'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:18.468030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9205ee-f56f-40ae-9b97-3b36800ac407 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:18.475279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:18.475988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.476259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.476548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.479226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:18.536538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 851/1714] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:18 2022] DELETE /identity/v3/users/280b3585252d4783993c8735ae76f188 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:18.538822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45abc-6fe0-471a-b8b7-c6a255af04f6 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.539350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45abc-6fe0-471a-b8b7-c6a255af04f6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.542161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45abc-6fe0-471a-b8b7-c6a255af04f6 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.547827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 852/1715] 10.222.0.42 () {54 vars in 912 bytes} [Tue May 3 16:28:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:18.548808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45abc-6fe0-471a-b8b7-c6a255af04f6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:18.552425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c4e45abc-6fe0-471a-b8b7-c6a255af04f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:18.557130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:18.559852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fbfa6-8cce-471b-b10e-406d558004d1 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:18.592574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 864/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:18.594153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328bcd7-bf0d-4d4e-ad4b-a2e6057e48d5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.594811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328bcd7-bf0d-4d4e-ad4b-a2e6057e48d5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.598766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328bcd7-bf0d-4d4e-ad4b-a2e6057e48d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.628312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e328bcd7-bf0d-4d4e-ad4b-a2e6057e48d5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:18.630468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e328bcd7-bf0d-4d4e-ad4b-a2e6057e48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:18.722491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45abc-6fe0-471a-b8b7-c6a255af04f6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:18.735824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:18.736823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.748109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.748754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.750849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:18.757081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:18.787334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 865/1717] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:18.788850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:18.791713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:18.792499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:18.838934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:18.842273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:18.900753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 853/1718] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:18 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:18.902056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:18.904724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:19.011622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 866/1719] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:19.012643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:19.014911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:19.041931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71849d5-214d-42d4-b329-e33848a445f5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:19.048669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:19.049338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.049621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.049897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.074449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:19.076086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:19.077483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43454-1271-4ccf-a8c2-9986828c66ba admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:19.081484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:19.082413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.082701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.082978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.085031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:19.101541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 867/1720] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:19.103106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:19.119550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973ceb0-620c-4ba3-9c35-e418f6186956 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:19.135149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:19.135870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.136151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.136428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.137155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:19.138931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:19.167638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 868/1721] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:19.167638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:19.176172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:19.192268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aeb26-8b82-4304-be90-50db60097ae4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:19.198291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:19.199024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.199656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.199942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.204992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:19.212676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:19.213354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:19.217932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:19.240860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 869/1722] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:19.243089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:19.252420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 854/1723] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:19.302004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0f0d2-604d-4610-8fa4-8f06fac4810b service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:19.315381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc9912-3214-45be-b9d4-888d6055a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:19.317620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc9912-3214-45be-b9d4-888d6055a46b admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.317919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc9912-3214-45be-b9d4-888d6055a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.318996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc9912-3214-45be-b9d4-888d6055a46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.321575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc9912-3214-45be-b9d4-888d6055a46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:19.325356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc9912-3214-45be-b9d4-888d6055a46b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:19.353424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 870/1724] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:19.358544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:19.377695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefb03-5b38-42c0-a6ad-883054aa2178 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:19.391201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568a7d-7bec-4e8a-8960-120de0327375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:19.395963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568a7d-7bec-4e8a-8960-120de0327375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.395963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568a7d-7bec-4e8a-8960-120de0327375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.395963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568a7d-7bec-4e8a-8960-120de0327375 admin admin] PATH_INFO: `/v3/projects/51731be7c1fb4d5cbb6019aa26d5fad6/users/5501955e3e8643cd90c8034f08b427f0/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.411423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22568a7d-7bec-4e8a-8960-120de0327375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51731be7c1fb4d5cbb6019aa26d5fad6, user_id=5501955e3e8643cd90c8034f08b427f0, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:19.415344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22568a7d-7bec-4e8a-8960-120de0327375 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:19.483068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.483392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.483677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.559894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 855/1725] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:19 2022] PUT /identity/v3/projects/51731be7c1fb4d5cbb6019aa26d5fad6/users/5501955e3e8643cd90c8034f08b427f0/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:19.570454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:19.571497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:19.571937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:19.590615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:19.592068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:19.670531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] MFA Rules not processed for user `5501955e3e8643cd90c8034f08b427f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:19.676094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:19.763522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 871/1726] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:28:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:19.874592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 856/1727] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:19.879461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:20.048982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dd260-a6a2-455b-bb3c-b7c9156ade73 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:20.063890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:20.064336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:20.065640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:20.065640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:20.065785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:20.068119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:20.104851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:20.106652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:20.146314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5204594-7ff9-4b62-9dc3-3cb6b07d8bb6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:20.161535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:20.163387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:20.163783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:20.164164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] PATH_INFO: `/v3/projects/e839f234942d48419463e396c062b641` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:20.167346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e839f234942d48419463e396c062b641)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:20.169500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:20.178527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 872/1728] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:19 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:20.184160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:20.349868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e839f234942d48419463e396c062b641', 'request_id': 'req-27f91db1-e085-4bce-9404-da66ca7b24a1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:20.388768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e839f234942d48419463e396c062b641', 'request_id': 'req-27f91db1-e085-4bce-9404-da66ca7b24a1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:20.391440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd77a8-1495-4e09-a375-f86fbf6801de admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:20.407065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e839f234942d48419463e396c062b641', 'request_id': 'req-27f91db1-e085-4bce-9404-da66ca7b24a1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:20.507230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] The token cache is being invalidate because project e839f234942d48419463e396c062b641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:20.507582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:20.514543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:20.520376 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 857/1729] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:20 2022] DELETE /identity/v3/projects/e839f234942d48419463e396c062b641 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:20.523329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:20.533243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:20.557807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:20.558510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:20.558799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:20.559450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:20.559877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:20.562085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:20.723586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f91db1-e085-4bce-9404-da66ca7b24a1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:20.733511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:20.734582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:20.734703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:20.734989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:20.737831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:20.746353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 873/1730] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:20 2022] POST /identity/v3/users => generated 299 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:20.747050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:20.754328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:20.778268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cf31e-bb59-4b13-8323-abe2c71e0ae0 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:20.792763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:20.793895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:20.794194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:20.794466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] PATH_INFO: `/v3/users/fad5fd277a2d449dba07e87bb3ca1486` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:20.798213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad5fd277a2d449dba07e87bb3ca1486)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:20.800305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:20.869731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:20.878066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:20.892597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 858/1731] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:28:20.893561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:20.895902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:20.920986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6301-13dc-42f8-b6bb-06881f235212 service swift] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:20.932164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:20.933991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:20.934519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:20.935015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:20.936550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:20.939310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:20.974075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 859/1732] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:20.978245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:21.015748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df4ba6-2cf5-4316-81bc-f95b290b09f5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:21.068382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:21.069839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:21.073602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:21.075643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] PATH_INFO: `/v3/projects/46202aca349d4ff4897cb672b10336e2/users/9e5ffe3f9d374d5cba1b2ac3cb3e9fa6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:21.082686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad5fd277a2d449dba07e87bb3ca1486'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:21.111171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad5fd277a2d449dba07e87bb3ca1486'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:21.112533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad5fd277a2d449dba07e87bb3ca1486'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:21.113519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad5fd277a2d449dba07e87bb3ca1486'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:21.142141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46202aca349d4ff4897cb672b10336e2, user_id=9e5ffe3f9d374d5cba1b2ac3cb3e9fa6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:21.148748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:21.236413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5ec000b3-18cc-40b6-8a9b-3925004738be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad5fd277a2d449dba07e87bb3ca1486'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:21.249568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 860/1733] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:20 2022] PUT /identity/v3/projects/46202aca349d4ff4897cb672b10336e2/users/9e5ffe3f9d374d5cba1b2ac3cb3e9fa6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:21.251086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:21.253249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:21.288817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 874/1734] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:20 2022] DELETE /identity/v3/users/fad5fd277a2d449dba07e87bb3ca1486 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:21.346832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:21.347188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:21.347541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:21.377353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] MFA Rules not processed for user `b6e168c909c64a48bcc2762081ed0658`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:21.378918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:21.488021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91346ce-a0a9-45ec-8f47-38845cac4a1c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:21.692597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:21.693284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:21.693577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:21.693844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:21.694590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:21.698333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:21.725319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 861/1735] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:21.739371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:21.761902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27141-04db-4182-8575-fd722d3cb8d9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:21.767454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79fb2-99d5-41af-8d03-4a3344e89528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:21.768483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79fb2-99d5-41af-8d03-4a3344e89528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:21.768778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79fb2-99d5-41af-8d03-4a3344e89528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:21.769056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79fb2-99d5-41af-8d03-4a3344e89528 admin admin] PATH_INFO: `/v3/projects/46202aca349d4ff4897cb672b10336e2/users/9e5ffe3f9d374d5cba1b2ac3cb3e9fa6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:21.771736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79fb2-99d5-41af-8d03-4a3344e89528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46202aca349d4ff4897cb672b10336e2, user_id=9e5ffe3f9d374d5cba1b2ac3cb3e9fa6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:21.777510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79fb2-99d5-41af-8d03-4a3344e89528 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:21.873742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 862/1736] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:21 2022] PUT /identity/v3/projects/46202aca349d4ff4897cb672b10336e2/users/9e5ffe3f9d374d5cba1b2ac3cb3e9fa6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:21.877468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104941d-57e2-4d63-b205-da74e594041a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:21.879228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104941d-57e2-4d63-b205-da74e594041a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:21.880579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104941d-57e2-4d63-b205-da74e594041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:21.965867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e104941d-57e2-4d63-b205-da74e594041a None None] MFA Rules not processed for user `9e5ffe3f9d374d5cba1b2ac3cb3e9fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:21.968329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e104941d-57e2-4d63-b205-da74e594041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:22.036495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 875/1737] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 691 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:22.165501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 863/1738] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:22.180669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:22.182548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:22.249955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478be48-c7e8-4241-bba8-7842a8f1122d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:22.296724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104941d-57e2-4d63-b205-da74e594041a None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:22.299055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e104941d-57e2-4d63-b205-da74e594041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:22.349435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b07c-1201-44f3-ac52-659174c445c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:22.350247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b07c-1201-44f3-ac52-659174c445c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:22.350721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b07c-1201-44f3-ac52-659174c445c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:22.351158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b07c-1201-44f3-ac52-659174c445c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:22.381615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7b07c-1201-44f3-ac52-659174c445c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:22.383780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7b07c-1201-44f3-ac52-659174c445c0 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:22.409494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 876/1739] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:22.511336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104941d-57e2-4d63-b205-da74e594041a None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:22.554917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:22.560626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:22.561528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:22.563031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] PATH_INFO: `/v3/projects/7fc3db34cb704239871baaa586c1da56` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:22.567373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc3db34cb704239871baaa586c1da56)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:22.579837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:22.831743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc3db34cb704239871baaa586c1da56', 'request_id': 'req-80311ec4-9889-49d2-b365-134240d89725'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:22.848806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc3db34cb704239871baaa586c1da56', 'request_id': 'req-80311ec4-9889-49d2-b365-134240d89725'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:22.862087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc3db34cb704239871baaa586c1da56', 'request_id': 'req-80311ec4-9889-49d2-b365-134240d89725'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:23.201867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] The token cache is being invalidate because project 7fc3db34cb704239871baaa586c1da56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:23.202220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:23.202884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-80311ec4-9889-49d2-b365-134240d89725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:23.219704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 864/1740] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:22 2022] DELETE /identity/v3/projects/7fc3db34cb704239871baaa586c1da56 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:23.221470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:23.222364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:23.222848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:23.259771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:23.261463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:23.406107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 877/1741] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:23.415761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:23.415957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:23.416248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:23.438596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:23.440165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:23.452707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 865/1742] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:23.458925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:23.472912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104c3fe-b11c-4846-93c4-b01af8fae625 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:23.478407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:23.480079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:23.480530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:23.480803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:23.481718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:23.482045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:23.483830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:23.515684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:23.516242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 878/1743] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:23.528148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97227-b5d1-431a-b6a6-d133b4149f81 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:23.532776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:23.533729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:23.533729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:23.533952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:23.534638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:23.536554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:23.664842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 866/1744] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:23 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:23.669605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:23.685204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348cf8c-8730-4f2f-ada4-860c8cecdc4b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:23.774121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:23.774805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:23.775088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:23.775403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:23.776120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:23.778030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:23.927411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 879/1745] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:23 2022] POST /identity/v3/users => generated 284 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:23.932212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:23.956521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cd927-80e9-4358-b3c7-f5e12433df44 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:23.966134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:23.966688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:23.967086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:23.967476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:23.973535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:23.975910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:23.988926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 867/1746] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:23.993689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:24.005721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f13fd8-8d76-41a1-a3ea-4ad7908b6335 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:24.013080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f501b-d505-4559-b049-ba5cb6c3acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:24.013751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f501b-d505-4559-b049-ba5cb6c3acee admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.014466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f501b-d505-4559-b049-ba5cb6c3acee admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.014776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f501b-d505-4559-b049-ba5cb6c3acee admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.015852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f501b-d505-4559-b049-ba5cb6c3acee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:24.017593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f501b-d505-4559-b049-ba5cb6c3acee admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:24.028583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 880/1747] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:28:24.032786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:24.046807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec222-9b44-4e78-b290-20dd92d637b6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:24.051984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf1bc-39db-4d08-8dab-6c1bd858507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:24.053055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf1bc-39db-4d08-8dab-6c1bd858507a admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.053413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf1bc-39db-4d08-8dab-6c1bd858507a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.053617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf1bc-39db-4d08-8dab-6c1bd858507a admin admin] PATH_INFO: `/v3/projects/8447ce5e644c4507a72d06cfc4fb55c6/users/b4d02bcfe94b495d8acdfdf0e88a9c1e/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.097961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbf1bc-39db-4d08-8dab-6c1bd858507a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8447ce5e644c4507a72d06cfc4fb55c6, user_id=b4d02bcfe94b495d8acdfdf0e88a9c1e, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:24.100832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbf1bc-39db-4d08-8dab-6c1bd858507a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:24.188435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 868/1748] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:24 2022] PUT /identity/v3/projects/8447ce5e644c4507a72d06cfc4fb55c6/users/b4d02bcfe94b495d8acdfdf0e88a9c1e/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:24.191659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe8df-1e38-4789-bc9f-5c33f9fa8dea None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.192138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe8df-1e38-4789-bc9f-5c33f9fa8dea None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.192573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe8df-1e38-4789-bc9f-5c33f9fa8dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.284600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bb2fe8df-1e38-4789-bc9f-5c33f9fa8dea None None] MFA Rules not processed for user `b4d02bcfe94b495d8acdfdf0e88a9c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:24.285359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bb2fe8df-1e38-4789-bc9f-5c33f9fa8dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:24.366260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.366650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.367324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.434701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] MFA Rules not processed for user `bc1eb5755b1549e0b50c6f6a701a0d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:24.435766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:24.481574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 881/1749] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:24.483547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.485120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.485849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.537441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:24.537441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:24.597905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 869/1750] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:24.599500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:24.627744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 882/1751] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:24.673699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:24.675177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:24.696230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a830781-f0fb-49d1-8213-e7d4126b3fee None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:24.705120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:24.705942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.706224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.706502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.718845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:24.727291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:24.729346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a1043-6ad9-4c08-a3d2-56624dcc6b6f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:24.735638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:24.737824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.738175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.738468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.739181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:24.741666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:24.752656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 883/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:24.753513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:24.756568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:24.788998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163224bc-a221-44ed-aa9b-cbbdcdced0ee service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:24.797176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:24.798873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:24.799497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:24.799956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] PATH_INFO: `/v3/users/5501955e3e8643cd90c8034f08b427f0` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:24.801264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5501955e3e8643cd90c8034f08b427f0)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:24.803312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:24.963726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 870/1753] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:24 2022] POST /identity/v3/projects => generated 369 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:24.968309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:25.066563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cc00a-503d-4d6a-b400-8804340fb592 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:25.074063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:25.075061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.075614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.076071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.077063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:25.079305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:25.106624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5501955e3e8643cd90c8034f08b427f0'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:25.119791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5501955e3e8643cd90c8034f08b427f0'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:25.120676 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5501955e3e8643cd90c8034f08b427f0'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:25.121408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5501955e3e8643cd90c8034f08b427f0'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:25.227525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 871/1754] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:24 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:25.230206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:25.236498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:25.256528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4dc8-b3af-423a-964f-352992809c9b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:25.263875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:25.264729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.264824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.265084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.265872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:25.268268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:25.280637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 872/1755] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:25.285506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:25.288879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0b880f83-2882-4554-8e34-af8125ae0949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5501955e3e8643cd90c8034f08b427f0'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:25.296026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f588e6-47b4-46b5-b7c3-58c11b179753 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:25.307087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 884/1756] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:24 2022] DELETE /identity/v3/users/5501955e3e8643cd90c8034f08b427f0 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:25.307290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:25.307290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.307290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.307290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] PATH_INFO: `/v3/projects/b69e99cb62004b04b1d552266ea98e2a/users/eae1b92a811040d79e9201e1d608f66a/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.309120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.309593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.309980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.331093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:25.332626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:25.340800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69e99cb62004b04b1d552266ea98e2a, user_id=eae1b92a811040d79e9201e1d608f66a, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:25.346916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:25.465139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 873/1757] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:25 2022] PUT /identity/v3/projects/b69e99cb62004b04b1d552266ea98e2a/users/eae1b92a811040d79e9201e1d608f66a/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:25.466206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:25.467507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 885/1758] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:25.487893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:25.490359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:25.609682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bf9a-7148-4cc4-9518-96fed6e83ff1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:25.626984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b8c9-a950-4097-9883-04cd02c59cd4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:25.641067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:25.644101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.644753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.645117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.645786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:25.652288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:25.700657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 874/1759] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:25.701636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:25.750084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192a221-346c-4eca-a59a-4c01e95034e1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:25.756860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00c75a-264e-458a-9194-a59ceef1a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:25.758449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00c75a-264e-458a-9194-a59ceef1a7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.762605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00c75a-264e-458a-9194-a59ceef1a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.762931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00c75a-264e-458a-9194-a59ceef1a7b6 admin admin] PATH_INFO: `/v3/projects/b69e99cb62004b04b1d552266ea98e2a/users/eae1b92a811040d79e9201e1d608f66a/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.768083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00c75a-264e-458a-9194-a59ceef1a7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69e99cb62004b04b1d552266ea98e2a, user_id=eae1b92a811040d79e9201e1d608f66a, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:25.786627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00c75a-264e-458a-9194-a59ceef1a7b6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:25.820924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:25.822172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.827155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.827155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.829971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 875/1760] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:25 2022] PUT /identity/v3/projects/b69e99cb62004b04b1d552266ea98e2a/users/eae1b92a811040d79e9201e1d608f66a/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:25.840411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:25.840706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:25.840982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:25.858428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:25.867804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:25.881786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 886/1761] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:25.919469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] MFA Rules not processed for user `eae1b92a811040d79e9201e1d608f66a`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:25.921385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:26.193676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 876/1762] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:26.284737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:26.286665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:26.428402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:26.430330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:26.452433 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754044e-5d0b-42b8-924f-f6bfb8535703 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:26.599294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eb380-d4a7-4734-9da2-a2cec67dad96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:26.600806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eb380-d4a7-4734-9da2-a2cec67dad96 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:26.601106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eb380-d4a7-4734-9da2-a2cec67dad96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:26.601427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eb380-d4a7-4734-9da2-a2cec67dad96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:26.628414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dba119-9282-4d10-9f3c-258a2c11c468 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:26.640452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eb380-d4a7-4734-9da2-a2cec67dad96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:26.646219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eb380-d4a7-4734-9da2-a2cec67dad96 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:26.648221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:26.651554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:26.657138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:26.657138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] PATH_INFO: `/v3/users/7a9a8cb8618742b59e174603160d9146` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:26.660431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9a8cb8618742b59e174603160d9146)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:26.670610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:26.700219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 887/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:26.996319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9a8cb8618742b59e174603160d9146'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:26.998695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de0df9-aa08-41c1-8a36-f25367f62a78 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:26.998983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de0df9-aa08-41c1-8a36-f25367f62a78 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:26.999353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de0df9-aa08-41c1-8a36-f25367f62a78 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:27.000735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 888/1764] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:28:27.009539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732a63-b941-4d82-a602-14c61fdada1b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:27.009821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732a63-b941-4d82-a602-14c61fdada1b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:27.010096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732a63-b941-4d82-a602-14c61fdada1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:27.027402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9a8cb8618742b59e174603160d9146'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.027402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9a8cb8618742b59e174603160d9146'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.027402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9a8cb8618742b59e174603160d9146'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.063229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9a8cb8618742b59e174603160d9146'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.063685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ed732a63-b941-4d82-a602-14c61fdada1b None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:27.066050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ed732a63-b941-4d82-a602-14c61fdada1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:27.180969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 877/1765] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:26 2022] DELETE /identity/v3/users/7a9a8cb8618742b59e174603160d9146 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:27.181905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:27.185238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:27.224495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 889/1766] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:27.226120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:27.227085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:27.227538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:27.272072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:27.275689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:27.299613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d415295-c2e5-4706-a688-59cbe81064b6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:27.307480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:27.309622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:27.311470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:27.312211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] PATH_INFO: `/v3/projects/51731be7c1fb4d5cbb6019aa26d5fad6` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:27.327709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51731be7c1fb4d5cbb6019aa26d5fad6)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:27.337846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:27.397831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 890/1767] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:27.400432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:27.402390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:27.559754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddb776-2fe2-4d90-ac12-10a24858587b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:27.614634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51731be7c1fb4d5cbb6019aa26d5fad6', 'request_id': 'req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.655696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51731be7c1fb4d5cbb6019aa26d5fad6', 'request_id': 'req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.680534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51731be7c1fb4d5cbb6019aa26d5fad6', 'request_id': 'req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.806883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:27.808419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:27.815908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:27.815908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:27.816509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] The token cache is being invalidate because project 51731be7c1fb4d5cbb6019aa26d5fad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:27.816509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.816509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:27.816509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 878/1768] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:27 2022] DELETE /identity/v3/projects/51731be7c1fb4d5cbb6019aa26d5fad6 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:27.816509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:27.822334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:27.830162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:27.831903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:27.851632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 891/1769] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:27.865973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:28.042276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1584-79a5-44bf-97cc-875393fba4cf service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:28.045690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:28.047350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:28.047994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:28.048588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] PATH_INFO: `/v3/users/9e5ffe3f9d374d5cba1b2ac3cb3e9fa6` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:28.051121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5ffe3f9d374d5cba1b2ac3cb3e9fa6)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:28.053290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:28.129493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0f7f-bb7c-4d54-b0ff-7df8b2d42bd2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:28.166211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:28.171281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:28.172657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:28.175824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:28.184885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:28.234396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:28.237439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:28.281683 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 879/1770] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:28.374675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5ffe3f9d374d5cba1b2ac3cb3e9fa6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:28.401788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5ffe3f9d374d5cba1b2ac3cb3e9fa6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:28.402965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5ffe3f9d374d5cba1b2ac3cb3e9fa6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:28.404693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5ffe3f9d374d5cba1b2ac3cb3e9fa6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:28.550240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6d822fd7-f4fe-4f87-b132-9bf02f67301e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5ffe3f9d374d5cba1b2ac3cb3e9fa6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:28.571248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 892/1771] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:27 2022] DELETE /identity/v3/users/9e5ffe3f9d374d5cba1b2ac3cb3e9fa6 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:29.463484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:29.464992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:29.489020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f648-7c86-480b-88d4-4c926b9de51b service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:29.624346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:29.625295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:29.625585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:29.625872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] PATH_INFO: `/v3/projects/9dfbe8d199574957aa9d6cab58de8df4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:29.634978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfbe8d199574957aa9d6cab58de8df4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:29.634978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:29.905565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfbe8d199574957aa9d6cab58de8df4', 'request_id': 'req-5dd435e4-0d64-446d-b95b-8b99d8584f24'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:29.920756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfbe8d199574957aa9d6cab58de8df4', 'request_id': 'req-5dd435e4-0d64-446d-b95b-8b99d8584f24'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:29.943723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfbe8d199574957aa9d6cab58de8df4', 'request_id': 'req-5dd435e4-0d64-446d-b95b-8b99d8584f24'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.043005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] The token cache is being invalidate because project 9dfbe8d199574957aa9d6cab58de8df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:30.053351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.057849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.057849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 880/1772] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:29 2022] DELETE /identity/v3/projects/9dfbe8d199574957aa9d6cab58de8df4 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:30.062734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60509c2-15d2-44c7-9598-c6d905075824 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:30.063679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60509c2-15d2-44c7-9598-c6d905075824 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:30.064179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60509c2-15d2-44c7-9598-c6d905075824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:30.089052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:30.090659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:30.152192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c60509c2-15d2-44c7-9598-c6d905075824 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:30.161801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c60509c2-15d2-44c7-9598-c6d905075824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:30.312771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd435e4-0d64-446d-b95b-8b99d8584f24 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:30.324951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:30.336668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:30.336668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:30.336668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] PATH_INFO: `/v3/projects/46202aca349d4ff4897cb672b10336e2` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:30.336668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46202aca349d4ff4897cb672b10336e2)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:30.337654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:30.395575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 893/1773] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:30.403306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:30.403758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:30.404340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:30.468869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:30.470484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:30.499951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 894/1774] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:30.504831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:30.545270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f8575-e22a-449e-8a6a-db6d9d3132be None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:30.578744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:30.581187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:30.585244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:30.587156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:30.588324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:30.589229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:30.590510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:30.613235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46202aca349d4ff4897cb672b10336e2', 'request_id': 'req-896528c5-136f-4ee6-8837-0cabcfc15e84'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.648081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46202aca349d4ff4897cb672b10336e2', 'request_id': 'req-896528c5-136f-4ee6-8837-0cabcfc15e84'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.658872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 895/1775] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:30.665104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:30.695208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46202aca349d4ff4897cb672b10336e2', 'request_id': 'req-896528c5-136f-4ee6-8837-0cabcfc15e84'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.714674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018494a8-50fa-4535-a0a0-ead63297d0a6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:30.791369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] The token cache is being invalidate because project 46202aca349d4ff4897cb672b10336e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:30.791654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.793027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-896528c5-136f-4ee6-8837-0cabcfc15e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:30.795195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 881/1776] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:30 2022] DELETE /identity/v3/projects/46202aca349d4ff4897cb672b10336e2 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:30.805359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb98f-65f2-4064-86a4-6703b22be97c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:30.805644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb98f-65f2-4064-86a4-6703b22be97c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:30.806083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb98f-65f2-4064-86a4-6703b22be97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:30.865769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-31afb98f-65f2-4064-86a4-6703b22be97c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:30.868379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-31afb98f-65f2-4064-86a4-6703b22be97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:30.920298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:30.932774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:30.932774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:30.932774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:30.932774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:30.932774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.083013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 882/1777] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:31.092720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.094478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.094777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.106061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 896/1778] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:30 2022] POST /identity/v3/projects => generated 365 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:31.111936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.118300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:31.141608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:31.142675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:31.286057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 883/1779] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:31.297971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.310786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb28ba-dfa1-4a01-b98a-637bd66c5696 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.321704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e378cef-4953-4d5c-b0d8-2c9c355f1617 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.323432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.324121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.324394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.324665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.325397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:31.325831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.327474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.332780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.334162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.334888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.338043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.339296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.342949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.352709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 884/1780] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:31.363218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.395183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e538-7ee4-4452-857e-b5cf33f2e966 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.403956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.405498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.405982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.406461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.407390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.409499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.449031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 897/1781] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:31 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:31.453714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.471029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131561-a530-4dbc-89e3-f1caa8e31f0b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.488169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.489894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.491834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.494271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.496310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.504289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.519905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 898/1782] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:31.525952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.545716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748415-17c0-491b-9e80-53f08e3e8e61 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.555908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 885/1783] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:31 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:31.559098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.687919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.692801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.692801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.692801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.693736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.699600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.741597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 899/1784] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:31.756642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.781699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbca32-2a3b-4dae-85f7-c73db3b0bca8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.781699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.781699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.781699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.782497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.782497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.782689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfad3d-0b05-4ec6-a6e0-b8b92bfd27df admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:31.790149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.801457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18faf7-0c6f-479f-87d3-b8acb97665f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:31.802575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18faf7-0c6f-479f-87d3-b8acb97665f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.803010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18faf7-0c6f-479f-87d3-b8acb97665f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.803553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18faf7-0c6f-479f-87d3-b8acb97665f4 admin admin] PATH_INFO: `/v3/projects/e0c878517945432da959258ff60d2820/users/d46899cb2536425982fa77a54f06f92e/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.831335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18faf7-0c6f-479f-87d3-b8acb97665f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c878517945432da959258ff60d2820, user_id=d46899cb2536425982fa77a54f06f92e, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:31.836166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18faf7-0c6f-479f-87d3-b8acb97665f4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:31.970475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 886/1785] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:31 2022] POST /identity/v3/users => generated 293 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:31.972640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:31.972850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 900/1786] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:31 2022] PUT /identity/v3/projects/e0c878517945432da959258ff60d2820/users/d46899cb2536425982fa77a54f06f92e/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:31.984455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:31.984814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:31.985168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:31.996930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8556-7740-4dc3-9f86-57d26a45283c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:32.024994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] MFA Rules not processed for user `d46899cb2536425982fa77a54f06f92e`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:32.026320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:32.222491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:32.223198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:32.223424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:32.223700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:32.224484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:32.226690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:32.263227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 887/1787] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:32.266912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 901/1788] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:32.272667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:32.274559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:32.281370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:32.297633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de420-2cfc-4895-ab4f-2101fcb9c1a1 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:32.317078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4270d-ad0d-4f87-931c-de19770fa106 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:32.324413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:32.326545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:32.326828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:32.327105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:32.328391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:32.330805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:32.334503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:32.336662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:32.337102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:32.337435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] PATH_INFO: `/v3/users/17d1daa2f8954bb38c0220173a2432cd` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:32.339660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d1daa2f8954bb38c0220173a2432cd)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:32.341610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:32.362161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 902/1789] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:32.369224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:32.400507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8fc83-9377-4ab9-adf0-54daf1cbd05c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:32.414811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:32.415521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:32.415801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:32.416079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:32.416773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:32.423056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:32.575980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 903/1790] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:32 2022] POST /identity/v3/projects => generated 363 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:32.580798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:32.700345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d1daa2f8954bb38c0220173a2432cd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:32.721156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d1daa2f8954bb38c0220173a2432cd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:32.723822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d1daa2f8954bb38c0220173a2432cd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:32.728980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d1daa2f8954bb38c0220173a2432cd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:32.755454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f38c-216d-4947-8f63-c652190e58cf admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:32.760782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d1daa2f8954bb38c0220173a2432cd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:32.773961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:32.774890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:32.775244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:32.775563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] PATH_INFO: `/v3/projects/de3fb3502dab4374ae0892175d19e23f/users/7feb369e95f8421b86c10179f4a4d0a2/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:32.813344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3fb3502dab4374ae0892175d19e23f, user_id=7feb369e95f8421b86c10179f4a4d0a2, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:32.823341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:32.871216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 888/1791] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:32 2022] DELETE /identity/v3/users/17d1daa2f8954bb38c0220173a2432cd => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:32.872690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:32.876155 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:32.948002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 904/1792] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:32 2022] PUT /identity/v3/projects/de3fb3502dab4374ae0892175d19e23f/users/7feb369e95f8421b86c10179f4a4d0a2/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:32.948002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:32.958201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.012479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea87db-b792-4a34-aae3-dbaa17f7211e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:33.128394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8be46-db49-4daa-9074-027ee26fe0b8 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:33.138678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:33.139738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.140344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.140629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] PATH_INFO: `/v3/users/b4d02bcfe94b495d8acdfdf0e88a9c1e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.141918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d02bcfe94b495d8acdfdf0e88a9c1e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:33.150253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:33.180254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44febf4-8273-4ec9-84f7-7abf0f152683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:33.180967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44febf4-8273-4ec9-84f7-7abf0f152683 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.181276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44febf4-8273-4ec9-84f7-7abf0f152683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.181532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44febf4-8273-4ec9-84f7-7abf0f152683 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.182232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44febf4-8273-4ec9-84f7-7abf0f152683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:33.184230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44febf4-8273-4ec9-84f7-7abf0f152683 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:33.318638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 889/1793] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:32 2022] POST /identity/v3/users => generated 288 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:33.320887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288af4d-7300-472d-905a-aefaae3f39f9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.321353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288af4d-7300-472d-905a-aefaae3f39f9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.322309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288af4d-7300-472d-905a-aefaae3f39f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.352746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9288af4d-7300-472d-905a-aefaae3f39f9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:33.354334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9288af4d-7300-472d-905a-aefaae3f39f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.362546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 890/1794] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:33.364499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9dff-35f2-4125-a95b-cec70a62a9a4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.365003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9dff-35f2-4125-a95b-cec70a62a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.365492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9dff-35f2-4125-a95b-cec70a62a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.424794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-307a9dff-35f2-4125-a95b-cec70a62a9a4 None None] MFA Rules not processed for user `7feb369e95f8421b86c10179f4a4d0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:33.426336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-307a9dff-35f2-4125-a95b-cec70a62a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.463630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d02bcfe94b495d8acdfdf0e88a9c1e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:33.492877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d02bcfe94b495d8acdfdf0e88a9c1e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:33.493854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d02bcfe94b495d8acdfdf0e88a9c1e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:33.494517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d02bcfe94b495d8acdfdf0e88a9c1e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:33.595102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d02bcfe94b495d8acdfdf0e88a9c1e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:33.604768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 891/1795] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:33.624364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962af1-e84c-43a1-9377-0898b893a999 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.628905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962af1-e84c-43a1-9377-0898b893a999 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.628905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962af1-e84c-43a1-9377-0898b893a999 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.628905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 892/1796] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:28:33 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:33.629513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962af1-e84c-43a1-9377-0898b893a999 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:33.633097 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fa962af1-e84c-43a1-9377-0898b893a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.656543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962af1-e84c-43a1-9377-0898b893a999 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:33.660961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 905/1797] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:32 2022] DELETE /identity/v3/users/b4d02bcfe94b495d8acdfdf0e88a9c1e => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:33.671756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:33.674808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.846156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18db90-20a1-490e-b09a-c9b57b8a2721 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:33.847059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:33.857266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:33.857266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.857266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.857266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.864338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.864607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.864607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.864607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.864607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:33.867851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:33.882337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:33.883113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 893/1798] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:33.884204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe688a6e-98f5-49e5-98c7-e1aea6851bfb service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:33.884824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:33.887072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.919472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 906/1799] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:33.921279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad588f-716a-41fc-b14b-4e11e9a64e47 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.921792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad588f-716a-41fc-b14b-4e11e9a64e47 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.922264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad588f-716a-41fc-b14b-4e11e9a64e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.942682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4fad588f-716a-41fc-b14b-4e11e9a64e47 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:33.944315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4fad588f-716a-41fc-b14b-4e11e9a64e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:33.954380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 907/1800] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:33.956571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.957070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.957758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.962026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533513-0212-4a24-a031-de33c18f2d8b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:33.965999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:33.966647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:33.971232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:33.971232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:33.983802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:33.985438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:34.034310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.035840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.047336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 894/1801] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:34.048023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.062501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601eb0-854c-4cfb-a42f-09c1c6eb8bc3 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:34.068891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:34.069478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.070078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.070920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] PATH_INFO: `/v3/projects/2f951395b105408a998618384602127e/users/71cb9780a8ae4adcb4b63809ad34a859/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.091850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 908/1802] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:34.094119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f951395b105408a998618384602127e, user_id=71cb9780a8ae4adcb4b63809ad34a859, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.094727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.098935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.111152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d57c-32e5-4599-854e-604489e71359 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:34.114874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:34.115571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.115866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.116142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.141689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.145564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.178108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 909/1803] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:34.184531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.186394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:34.223802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf269-2f60-4640-b585-96c79d3764d1 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:34.242339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:34.243446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.243839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.244132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] PATH_INFO: `/v3/users/7feb369e95f8421b86c10179f4a4d0a2` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.246108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feb369e95f8421b86c10179f4a4d0a2)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.248573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.253381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 895/1804] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:34 2022] PUT /identity/v3/projects/2f951395b105408a998618384602127e/users/71cb9780a8ae4adcb4b63809ad34a859/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:34.254505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.264245 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:34.462787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab3181-adf1-48e8-b2d1-673454006abb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:34.471797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:34.473141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.473340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.473599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.522385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feb369e95f8421b86c10179f4a4d0a2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:34.523086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.528900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.565631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 896/1805] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:34.566747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.568017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feb369e95f8421b86c10179f4a4d0a2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:34.568970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feb369e95f8421b86c10179f4a4d0a2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:34.575443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feb369e95f8421b86c10179f4a4d0a2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:34.675604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c388e651-0cbc-4cfe-922d-abdbd4144b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feb369e95f8421b86c10179f4a4d0a2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:34.718514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 910/1806] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:34 2022] DELETE /identity/v3/users/7feb369e95f8421b86c10179f4a4d0a2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:34.736582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e66a2-20be-401d-bbf6-9223687b7309 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.746088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e66a2-20be-401d-bbf6-9223687b7309 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.747795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c9df-b143-49fa-8582-3fae5e91778e service nova] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:34.748250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e66a2-20be-401d-bbf6-9223687b7309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.817627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-014e66a2-20be-401d-bbf6-9223687b7309 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:34.820460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-014e66a2-20be-401d-bbf6-9223687b7309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:34.888399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:34.888399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.888399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.888399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.891730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.891730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.896400 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 897/1807] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:34.900259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.902328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:34.917980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6220ae5-b028-457f-974b-e971e339fa21 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:34.945515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:34.945515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.945515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.945515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] PATH_INFO: `/v3/projects/2f951395b105408a998618384602127e/users/71cb9780a8ae4adcb4b63809ad34a859/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.946494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f951395b105408a998618384602127e, user_id=71cb9780a8ae4adcb4b63809ad34a859, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:34.946494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:34.946822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 911/1808] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:34.948131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 898/1809] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:34 2022] PUT /identity/v3/projects/2f951395b105408a998618384602127e/users/71cb9780a8ae4adcb4b63809ad34a859/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:34.958941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:34.962010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:34.962601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:34.969366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:34.977660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:35.019631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] MFA Rules not processed for user `71cb9780a8ae4adcb4b63809ad34a859`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:35.019631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:35.135516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc31f-e59b-4207-aca8-d4f701e65465 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:35.143273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:35.144094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:35.144509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:35.144962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:35.248667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 912/1810] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:35.268647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:35.270138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:35.301375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:35.303536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:35.332943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 899/1811] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:35.372607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf918-5f2a-417c-98bc-a044758b289f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:35.381853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:35.385686 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:35.386164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:35.387646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:35.417545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:35.419116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:35.438860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 913/1812] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:28:35.472744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:35.474274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:35.515235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414e04-0078-4c0b-add8-76fefa822852 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:35.528417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:35.531011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:35.531713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:35.533728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:35.535603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:35.535907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] PATH_INFO: `/v3/projects/89299153896a4cd09bfb766b0f968ff2` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:35.538706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89299153896a4cd09bfb766b0f968ff2)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:35.544390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:35.574503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6464d-b39f-4e1c-908e-2dcc4ad7b7f9 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:35.593741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:35.597120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:35.598547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:35.600249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] PATH_INFO: `/v3/projects/8447ce5e644c4507a72d06cfc4fb55c6` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:35.606435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8447ce5e644c4507a72d06cfc4fb55c6)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:35.613419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:35.746839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89299153896a4cd09bfb766b0f968ff2', 'request_id': 'req-d5230826-e358-4524-bcbc-65fa2bcd81a7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.756289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89299153896a4cd09bfb766b0f968ff2', 'request_id': 'req-d5230826-e358-4524-bcbc-65fa2bcd81a7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.785459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89299153896a4cd09bfb766b0f968ff2', 'request_id': 'req-d5230826-e358-4524-bcbc-65fa2bcd81a7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.801222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8447ce5e644c4507a72d06cfc4fb55c6', 'request_id': 'req-b447e3ed-1443-448d-ae28-341e0e18d036'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.884234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] The token cache is being invalidate because project 89299153896a4cd09bfb766b0f968ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:35.884701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.887513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.892805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 900/1813] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:35 2022] DELETE /identity/v3/projects/89299153896a4cd09bfb766b0f968ff2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:35.894279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:35.897016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:35.966272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8447ce5e644c4507a72d06cfc4fb55c6', 'request_id': 'req-b447e3ed-1443-448d-ae28-341e0e18d036'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:35.975486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8447ce5e644c4507a72d06cfc4fb55c6', 'request_id': 'req-b447e3ed-1443-448d-ae28-341e0e18d036'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.008221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] The token cache is being invalidate because project 8447ce5e644c4507a72d06cfc4fb55c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:36.012143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.013630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.019425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 914/1814] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:35 2022] DELETE /identity/v3/projects/8447ce5e644c4507a72d06cfc4fb55c6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:36.020454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:36.024221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:36.028476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230826-e358-4524-bcbc-65fa2bcd81a7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:36.134617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:36.135878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:36.136286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:36.137006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] PATH_INFO: `/v3/users/39e63ed7e0cb400aa7c8462f9d8480a6` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:36.139507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e63ed7e0cb400aa7c8462f9d8480a6)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:36.141965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:36.221765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447e3ed-1443-448d-ae28-341e0e18d036 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:36.230016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:36.231081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:36.234149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:36.234149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] PATH_INFO: `/v3/users/eae1b92a811040d79e9201e1d608f66a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:36.234149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae1b92a811040d79e9201e1d608f66a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:36.235677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:36.372017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e63ed7e0cb400aa7c8462f9d8480a6'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.390462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e63ed7e0cb400aa7c8462f9d8480a6'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.391813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e63ed7e0cb400aa7c8462f9d8480a6'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.392581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e63ed7e0cb400aa7c8462f9d8480a6'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.411524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e63ed7e0cb400aa7c8462f9d8480a6'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.474353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae1b92a811040d79e9201e1d608f66a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.489646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae1b92a811040d79e9201e1d608f66a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.490502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae1b92a811040d79e9201e1d608f66a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.492222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae1b92a811040d79e9201e1d608f66a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.532001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 901/1815] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:35 2022] DELETE /identity/v3/users/39e63ed7e0cb400aa7c8462f9d8480a6 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:36.621635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae1b92a811040d79e9201e1d608f66a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:36.630115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:36.635052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:36.655664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 915/1816] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:36 2022] DELETE /identity/v3/users/eae1b92a811040d79e9201e1d608f66a => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:36.740080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:36.742596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:36.764467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee30d5-53e5-4d7b-86bd-2e1ba7487ce9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:36.833573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5887e-438f-4fa9-be94-d1d7e97f0f94 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:36.839518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:36.839826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:36.840423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:36.840702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:36.841004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] PATH_INFO: `/v3/users/d46899cb2536425982fa77a54f06f92e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:36.841483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:36.841838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:36.842184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] PATH_INFO: `/v3/projects/de3fb3502dab4374ae0892175d19e23f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:36.842406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46899cb2536425982fa77a54f06f92e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:36.843894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3fb3502dab4374ae0892175d19e23f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:36.844631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:36.846378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:37.093213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46899cb2536425982fa77a54f06f92e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.096738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3fb3502dab4374ae0892175d19e23f', 'request_id': 'req-b5621e44-60fe-40a9-98a2-423f470000c7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.110365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3fb3502dab4374ae0892175d19e23f', 'request_id': 'req-b5621e44-60fe-40a9-98a2-423f470000c7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.116306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46899cb2536425982fa77a54f06f92e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.117614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46899cb2536425982fa77a54f06f92e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.127801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46899cb2536425982fa77a54f06f92e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.130820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3fb3502dab4374ae0892175d19e23f', 'request_id': 'req-b5621e44-60fe-40a9-98a2-423f470000c7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.234039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5b2b478e-c5a7-4aa6-8a5f-cbac8c6156f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46899cb2536425982fa77a54f06f92e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.248297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 916/1817] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:36 2022] DELETE /identity/v3/users/d46899cb2536425982fa77a54f06f92e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:37.257334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b51ad-a481-4255-9f37-53ee2821fb70 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.257630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b51ad-a481-4255-9f37-53ee2821fb70 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.257932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b51ad-a481-4255-9f37-53ee2821fb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.276778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e30b51ad-a481-4255-9f37-53ee2821fb70 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:37.281487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e30b51ad-a481-4255-9f37-53ee2821fb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.315951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] The token cache is being invalidate because project de3fb3502dab4374ae0892175d19e23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:37.316297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.319929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.319929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 902/1818] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:36 2022] DELETE /identity/v3/projects/de3fb3502dab4374ae0892175d19e23f => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:37.319929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:37.323171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.347029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 917/1819] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:37.348382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.348693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.349023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.371044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:37.372288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.391495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 918/1820] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:37.392123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:37.393663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.399288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5621e44-60fe-40a9-98a2-423f470000c7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:37.405083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:37.405967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.406238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.406569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] PATH_INFO: `/v3/projects/07dc88ec7e3542259a7290cc76c68f73` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.407793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07dc88ec7e3542259a7290cc76c68f73)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:37.411886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:37.479491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002f09-0123-4eb6-9193-81a0a810c567 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:37.483470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed429c-336a-4860-9566-d554964e75d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:37.484195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed429c-336a-4860-9566-d554964e75d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.484476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed429c-336a-4860-9566-d554964e75d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.484757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed429c-336a-4860-9566-d554964e75d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.497732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed429c-336a-4860-9566-d554964e75d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:37.499240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed429c-336a-4860-9566-d554964e75d9 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:37.513694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 919/1821] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:37.513694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.513694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.513694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.532772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:37.534104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.553229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07dc88ec7e3542259a7290cc76c68f73', 'request_id': 'req-41436033-f3e6-49f0-b1d7-70b88c04ac0b'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.572193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07dc88ec7e3542259a7290cc76c68f73', 'request_id': 'req-41436033-f3e6-49f0-b1d7-70b88c04ac0b'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.579633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07dc88ec7e3542259a7290cc76c68f73', 'request_id': 'req-41436033-f3e6-49f0-b1d7-70b88c04ac0b'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.618280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 920/1822] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:37.619377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:37.622421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.635579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d62cd7-0f43-4b96-917d-3dbfb49dc35c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:37.641046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:37.642117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.642541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.642967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] PATH_INFO: `/v3/projects/b69e99cb62004b04b1d552266ea98e2a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.644374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69e99cb62004b04b1d552266ea98e2a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:37.646586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:37.664388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] The token cache is being invalidate because project 07dc88ec7e3542259a7290cc76c68f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:37.664388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.664388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.668538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 903/1823] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:37 2022] DELETE /identity/v3/projects/07dc88ec7e3542259a7290cc76c68f73 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:37.668538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:37.668538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.686800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436033-f3e6-49f0-b1d7-70b88c04ac0b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:37.692269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:37.692942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.693233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.693523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.695158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:37.695511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:37.697458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d39b4-4d9b-4ee3-b401-e55553ed45f4 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:37.709883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 904/1824] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:37.711721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.712009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.712290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.731102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:37.732355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.740441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 905/1825] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:37.741210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:37.752157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860388a-806b-4a92-8ee2-3c544e642623 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:37.758302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95715999-f4e5-4914-97d7-fb251101f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:37.759087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95715999-f4e5-4914-97d7-fb251101f24c admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.759557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95715999-f4e5-4914-97d7-fb251101f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.760217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95715999-f4e5-4914-97d7-fb251101f24c admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.761062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95715999-f4e5-4914-97d7-fb251101f24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:37.762972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95715999-f4e5-4914-97d7-fb251101f24c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:37.818576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69e99cb62004b04b1d552266ea98e2a', 'request_id': 'req-5e3318ba-9f17-428c-b6e9-42565b002c4b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.876798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 906/1826] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:37.878146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cef19-c831-4075-ad8d-72f05e24da8b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.878501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cef19-c831-4075-ad8d-72f05e24da8b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.878789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cef19-c831-4075-ad8d-72f05e24da8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.897468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d45cef19-c831-4075-ad8d-72f05e24da8b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:37.898704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d45cef19-c831-4075-ad8d-72f05e24da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.903650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69e99cb62004b04b1d552266ea98e2a', 'request_id': 'req-5e3318ba-9f17-428c-b6e9-42565b002c4b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.909945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69e99cb62004b04b1d552266ea98e2a', 'request_id': 'req-5e3318ba-9f17-428c-b6e9-42565b002c4b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.922613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] The token cache is being invalidate because project b69e99cb62004b04b1d552266ea98e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:37.923016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.923806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:37.926383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 921/1827] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:37 2022] DELETE /identity/v3/projects/b69e99cb62004b04b1d552266ea98e2a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:37.930995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:37.932457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.971167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 907/1828] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:37.971167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:37.971167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:37.971167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:37.989295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:37.990721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:37.999761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 908/1829] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:38.000436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.010589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3318ba-9f17-428c-b6e9-42565b002c4b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.010934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b45de-a417-41c0-b8ac-89949033e1c2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.015450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.015697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.016158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.016331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.016424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.016576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.016677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.016858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.017372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.017589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:38.017899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.019306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.019540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612b42d-842f-421a-bb45-dc477bc07522 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.032203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 909/1830] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:38.033335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.033652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.033910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.054565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:38.055826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:38.064165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 910/1831] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:38.068461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.074944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73619a-57ba-4fcc-b42f-8220f9113e0c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.079697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.080380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.080673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.080948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.082179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.083702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.107976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 922/1832] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:37 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:38.109441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.121832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e8d45-1629-47b6-b379-e9bd4ae2d987 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.127395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.128333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.128617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.128900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.130222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:38.130222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.131697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.145422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 923/1833] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:38.149384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.162397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61357-1776-49eb-bf5b-62467baf06a1 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.169478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.170340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.170767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.171194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.172238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.173759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.188822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 911/1834] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:38 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:38.188822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.189843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 924/1835] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:38.190831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.206983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8366bb-ff3a-467c-86d1-6007e5f82d35 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.271813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.272492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.273328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.273605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.274837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.279957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.287163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d2c6-0622-4351-9afe-447dff66eb5f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.293498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.294313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.294591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.295041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.296063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.298428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.361394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 925/1836] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:38 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:38.362396 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.372184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0489dcb-5944-4d59-a859-a479781e95f2 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.377385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.378032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.378314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.378607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.379437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.381022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.391541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 926/1837] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:38.392428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.403507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4eb35-7e59-479d-9f7e-225bd8768558 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.408682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.409339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.409621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.410027 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.410741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.412464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.419694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 912/1838] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:38 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:38.420677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.424149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 927/1839] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:38.425175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.437629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad477c-2fd4-4728-8450-b3f007014d81 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.528802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.529494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.529778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.530055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.530763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.531170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5977-e2b0-48bd-8da4-90ddce34cf63 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.532787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.535898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.536781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.537090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.542561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] PATH_INFO: `/v3/projects/6598813cf61146b2b1b591fd04b70d74/users/5c6557583f224c0c83f3148c92a76163/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.551622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6598813cf61146b2b1b591fd04b70d74, user_id=5c6557583f224c0c83f3148c92a76163, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.554946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.778172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 928/1840] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:38 2022] POST /identity/v3/users => generated 287 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:38.779159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.789159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c2ed-7eba-4971-ad7e-db3cd38a5674 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.793575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.794246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.794525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.794794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.795515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.797086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.807737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 929/1841] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:38.808558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.810184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:38.818146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 913/1842] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:38 2022] PUT /identity/v3/projects/6598813cf61146b2b1b591fd04b70d74/users/5c6557583f224c0c83f3148c92a76163/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:38.823169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.824076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93692-b767-4daa-871a-84a909497564 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.881422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1f90-7676-4d0c-8730-37e826e77e40 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.882867 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.883782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.884064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.884335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] PATH_INFO: `/v3/projects/e0c878517945432da959258ff60d2820` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.885522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c878517945432da959258ff60d2820)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.886975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.887461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.887672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.887958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.888233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.888957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.890555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:38.900697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 914/1843] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:38.901485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:38.910864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a55ed-f854-4d51-927d-8fbbedcfbc7e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:38.916330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11274423-7bd5-4e48-9c68-fd53e1fb29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:38.917190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274423-7bd5-4e48-9c68-fd53e1fb29ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:38.917480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274423-7bd5-4e48-9c68-fd53e1fb29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:38.917776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274423-7bd5-4e48-9c68-fd53e1fb29ac admin admin] PATH_INFO: `/v3/projects/f244c01e004a4495a871ff3e90d66dda/users/6474c73bcfe542e2932007e466e2f887/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:38.933179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11274423-7bd5-4e48-9c68-fd53e1fb29ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f244c01e004a4495a871ff3e90d66dda, user_id=6474c73bcfe542e2932007e466e2f887, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:38.935890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11274423-7bd5-4e48-9c68-fd53e1fb29ac admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.046493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 915/1844] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:38 2022] PUT /identity/v3/projects/f244c01e004a4495a871ff3e90d66dda/users/6474c73bcfe542e2932007e466e2f887/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:39.047723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.048014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.048291 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.054803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c878517945432da959258ff60d2820', 'request_id': 'req-14b49929-c5d2-449a-9d69-7375064c26a6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.076329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] MFA Rules not processed for user `5c6557583f224c0c83f3148c92a76163`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:39.077900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.130427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c878517945432da959258ff60d2820', 'request_id': 'req-14b49929-c5d2-449a-9d69-7375064c26a6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.136489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c878517945432da959258ff60d2820', 'request_id': 'req-14b49929-c5d2-449a-9d69-7375064c26a6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.142048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 916/1845] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:39.142840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.154744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] The token cache is being invalidate because project e0c878517945432da959258ff60d2820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:39.154744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.154744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-14b49929-c5d2-449a-9d69-7375064c26a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.154744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 930/1846] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:38 2022] DELETE /identity/v3/projects/e0c878517945432da959258ff60d2820 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:39.154744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.155222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.155222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.180718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] MFA Rules not processed for user `6474c73bcfe542e2932007e466e2f887`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:39.181937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.216539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1534813-6e17-4e6f-a43a-850533198806 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.223076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.224029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.224590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.225219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.227088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.229153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.245251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 917/1847] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:39.245251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.247306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.255370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 931/1848] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:39.255370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.255993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.269882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f7c8-edd8-4bbf-9697-059dc034b609 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.275399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.276283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.276569 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.276852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] PATH_INFO: `/v3/users/71cb9780a8ae4adcb4b63809ad34a859` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.278080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71cb9780a8ae4adcb4b63809ad34a859)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.280033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.316175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4212dfa-5b84-4fc6-919e-48952958691f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.320014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.320743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.321031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.321313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.323118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.333771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.335808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.344918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 918/1849] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:39.346045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.347428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.361141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95db7bf-4781-433a-b9cb-5f0e00deb894 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.366023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.367273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.367587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.367873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] PATH_INFO: `/v3/projects/c03ef1aa7b144f80bf196937945716a1/users/525a4beedd2f4468b91928d8cbd3a8ab/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.383081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03ef1aa7b144f80bf196937945716a1, user_id=525a4beedd2f4468b91928d8cbd3a8ab, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.385749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.486936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 919/1850] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:39 2022] PUT /identity/v3/projects/c03ef1aa7b144f80bf196937945716a1/users/525a4beedd2f4468b91928d8cbd3a8ab/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:39.487851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.489444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.535019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71cb9780a8ae4adcb4b63809ad34a859'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.554488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71cb9780a8ae4adcb4b63809ad34a859'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.555564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71cb9780a8ae4adcb4b63809ad34a859'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.556360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71cb9780a8ae4adcb4b63809ad34a859'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.563268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36841-3ac4-4248-9f61-93052a83e183 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.568809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c4ab5-90d2-4fbc-b262-29aafdbc06ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.569565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c4ab5-90d2-4fbc-b262-29aafdbc06ae admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.569858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c4ab5-90d2-4fbc-b262-29aafdbc06ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.570172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c4ab5-90d2-4fbc-b262-29aafdbc06ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.570836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c4ab5-90d2-4fbc-b262-29aafdbc06ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.572959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c4ab5-90d2-4fbc-b262-29aafdbc06ae admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.669361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71cb9780a8ae4adcb4b63809ad34a859'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:39.679009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 920/1851] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:39 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:39.683467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.683744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.683919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.691005 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 932/1852] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:39 2022] DELETE /identity/v3/users/71cb9780a8ae4adcb4b63809ad34a859 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:39.694095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.694095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.735786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] MFA Rules not processed for user `525a4beedd2f4468b91928d8cbd3a8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:39.737262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.821202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6895b-5ee6-45f2-984f-87a5693fbb6e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.826424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.827295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.827579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.828103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.832363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.832363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.841729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 921/1853] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:39.842690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.844189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:39.860114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b5772-8779-49d9-a2b6-23ef363aed3f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.869102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.869938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.870223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.870498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.871191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.873459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.955615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 933/1854] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:39 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:39.961134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:39.973393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a52f59-fc9f-47cb-a0af-b5ba98756444 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:39.979900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:39.980584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:39.980866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:39.981139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:39.981902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:39.983505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:39.994512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 934/1855] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:39.998943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.010278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b234f-a542-43fb-b06e-ea4e42f99c88 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:40.015671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:40.016773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.017147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.017492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] PATH_INFO: `/v3/projects/00cd576177e5454dab5c6508536ef4be/users/98c65015b42b45eab9b49999077fc0a8/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.031334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 922/1856] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:39 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:40.033748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.035916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cd576177e5454dab5c6508536ef4be, user_id=98c65015b42b45eab9b49999077fc0a8, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:40.038859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:40.108936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744a9ec-c300-471e-af64-92f098e5be5a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:40.110457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 935/1857] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:39 2022] PUT /identity/v3/projects/00cd576177e5454dab5c6508536ef4be/users/98c65015b42b45eab9b49999077fc0a8/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:40.114397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.177011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03336c-eb69-4e80-8e4b-eb4ee1e4916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:40.177865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03336c-eb69-4e80-8e4b-eb4ee1e4916f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.178328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03336c-eb69-4e80-8e4b-eb4ee1e4916f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.178694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03336c-eb69-4e80-8e4b-eb4ee1e4916f admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.179585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03336c-eb69-4e80-8e4b-eb4ee1e4916f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:40.186280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03336c-eb69-4e80-8e4b-eb4ee1e4916f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:40.186391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821eeb9-2728-4ff1-8205-efa648f1e777 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:40.189253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:40.189925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.190208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.190824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.191270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:40.192864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:40.206701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 936/1858] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:40.208084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.219592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd3c7-78be-4d27-a5fe-2142d965f1ca admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:40.225136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:40.226695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.226997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.227338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] PATH_INFO: `/v3/projects/00cd576177e5454dab5c6508536ef4be/users/98c65015b42b45eab9b49999077fc0a8/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.229512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cd576177e5454dab5c6508536ef4be, user_id=98c65015b42b45eab9b49999077fc0a8, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:40.232425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:40.244249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 937/1859] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:40 2022] PUT /identity/v3/projects/00cd576177e5454dab5c6508536ef4be/users/98c65015b42b45eab9b49999077fc0a8/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:40.253965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.256007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:40.325452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd12f9-50f0-47dd-a01c-85ed2203e592 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:40.330572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:40.331453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.331734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.332007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] PATH_INFO: `/v3/projects/2f951395b105408a998618384602127e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.333207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f951395b105408a998618384602127e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:40.335852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:40.849496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 923/1860] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:40 2022] POST /identity/v3/users => generated 295 bytes in 816 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:40.870083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.870083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.870083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.885885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] MFA Rules not processed for user `98c65015b42b45eab9b49999077fc0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:40.887295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:40.963082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 924/1861] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:40.963996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.974590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054a5b6-81df-492c-86ef-860aaf345bad None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:40.979654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:40.980379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:40.980669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:40.980947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:40.981685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:40.983325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:40.994322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 925/1862] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:40.995197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:40.996823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.065896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e93b-82c0-4fbf-9302-c6a310d7c2c1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.070220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.070852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.071141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.071456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.081348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:41.082790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:41.093199 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 926/1863] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:41.093827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:41.103947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6bda-e22d-4229-91d1-231b01fa27db service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.110839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.112111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.112573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.112860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] PATH_INFO: `/v3/projects/8d87950c443a4090a4097b51dce728c4/users/8c81acb025174d2b8a5dce0b0449c748/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.131898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d87950c443a4090a4097b51dce728c4, user_id=8c81acb025174d2b8a5dce0b0449c748, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:41.136206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:41.529384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 927/1864] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:41 2022] PUT /identity/v3/projects/8d87950c443a4090a4097b51dce728c4/users/8c81acb025174d2b8a5dce0b0449c748/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:41.534679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:41.537945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f951395b105408a998618384602127e', 'request_id': 'req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:41.604131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f98f-d09a-478c-983e-cb78afc2f8b4 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.662911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.664468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.664744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.669433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.669433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:41.669433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:41.677622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 928/1865] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:41.681862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:41.691148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610dea-d406-431d-878d-236c802782c1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.695874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d03fec-85c3-4eca-b264-c716b80f326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.696720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03fec-85c3-4eca-b264-c716b80f326c admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.696998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03fec-85c3-4eca-b264-c716b80f326c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.697288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03fec-85c3-4eca-b264-c716b80f326c admin admin] PATH_INFO: `/v3/projects/8d87950c443a4090a4097b51dce728c4/users/8c81acb025174d2b8a5dce0b0449c748/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.699220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d03fec-85c3-4eca-b264-c716b80f326c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d87950c443a4090a4097b51dce728c4, user_id=8c81acb025174d2b8a5dce0b0449c748, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:41.701861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d03fec-85c3-4eca-b264-c716b80f326c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:41.712445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 929/1866] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:41 2022] PUT /identity/v3/projects/8d87950c443a4090a4097b51dce728c4/users/8c81acb025174d2b8a5dce0b0449c748/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:41.715453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f951395b105408a998618384602127e', 'request_id': 'req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:41.722842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f951395b105408a998618384602127e', 'request_id': 'req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:41.732797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d83a8a-f910-43d3-aa63-71d310ecca48 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.733134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d83a8a-f910-43d3-aa63-71d310ecca48 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.733436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d83a8a-f910-43d3-aa63-71d310ecca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.739937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] The token cache is being invalidate because project 2f951395b105408a998618384602127e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:41.740337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:41.741009 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b157bf3d-7d71-47fb-88aa-cec62bbd49b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:41.742670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 938/1867] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:40 2022] DELETE /identity/v3/projects/2f951395b105408a998618384602127e => generated 0 bytes in 1489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:41.747413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.747749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.747973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.762939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-54d83a8a-f910-43d3-aa63-71d310ecca48 None None] MFA Rules not processed for user `8c81acb025174d2b8a5dce0b0449c748`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:41.764342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-54d83a8a-f910-43d3-aa63-71d310ecca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.771190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:41.771190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.831937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 939/1868] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:41.832871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:41.834247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.842709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 930/1869] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:41.844064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.844357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.844680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.864228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:41.865157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.874899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 931/1870] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:41.876422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:41.877429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.897125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d61dbd-7d9b-4c69-8122-d91ecac217bc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.900953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.901591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.901876 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.902150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.903978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.935962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c53fd-c695-41d1-ade7-0104cefa5889 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.939714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.940358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.940643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.940920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.942748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:41.963061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:41.964545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:41.976539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 940/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:41.976539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:41.986553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35019fbd-a88b-4769-bbaa-ee97a08178c6 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:41.991342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:41.992262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:41.992646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:41.992875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:41.993627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:41.993933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:41.995555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.002968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.005308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.013840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 941/1872] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:42.014872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:42.015478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 932/1873] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:42.026103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea99840-df00-4b91-ad9c-1cd029b4ec00 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:42.031858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:42.034223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.034223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.034223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.034223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.035733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.128610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 942/1874] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:42 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:42.134030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:42.151720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf489a7-466e-47ed-8653-8b501f36daee service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:42.243205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:42.253665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.253665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.253665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.253665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.253665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.420109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 933/1875] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:42 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:42.421327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:42.432324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e54b57-fc83-4cd8-8799-88ba01523e8a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:42.436897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:42.437557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.437840 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.438117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.438966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.440485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.459326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 943/1876] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:28:42.460774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:42.473768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f35e5-0e4a-4827-b286-ccef18f30386 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:42.496895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34a642-4f3d-4e57-b941-70c5168bc0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:42.496895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a642-4f3d-4e57-b941-70c5168bc0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.496895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a642-4f3d-4e57-b941-70c5168bc0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.496895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a642-4f3d-4e57-b941-70c5168bc0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.497480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34a642-4f3d-4e57-b941-70c5168bc0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.497480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34a642-4f3d-4e57-b941-70c5168bc0c0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.521656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 934/1877] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:42.524425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:42.537554 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f98cb-f4f1-4fc6-8250-abb4c72a3ca9 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:42.542929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:42.543957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.544277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.544592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] PATH_INFO: `/v3/projects/3f32452f4199465d9f0586c81e3f863a/users/e4d3e3320d3449be822c5f9170e16219/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.566003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f32452f4199465d9f0586c81e3f863a, user_id=e4d3e3320d3449be822c5f9170e16219, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.569875 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:42.784328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 944/1878] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:42 2022] PUT /identity/v3/projects/3f32452f4199465d9f0586c81e3f863a/users/e4d3e3320d3449be822c5f9170e16219/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:42.795858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.796165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.796450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.848887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] MFA Rules not processed for user `e4d3e3320d3449be822c5f9170e16219`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:42.849977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:42.917093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 935/1879] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:42.921690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:42.988908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd32bb-d2b3-4fae-a883-de0e363cd706 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:42.994237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:42.994880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:42.995159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:42.995455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:42.996126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:42.998009 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.110827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 945/1880] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:42 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:43.114812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:43.125474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007b095-e980-4697-ba89-802dd4049c18 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:43.185567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:43.186611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.187143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.187823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.188609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:43.190630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.301083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 936/1881] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:43 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:43.301251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:43.312263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb1ff-6d20-4ed4-a0ca-3f41feffc42a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:43.322706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:43.323941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.324658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.324992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.325732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:43.327371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.341920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 946/1882] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:43.346169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:43.359143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b425cc-7ac3-43cf-970f-0dd8663d9e52 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:43.365702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:43.367825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.368159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.368447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] PATH_INFO: `/v3/projects/728d210319a34ef2aea187086982bfa4/users/1840802affbc40e0a608d8ddf94aed69/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.388007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728d210319a34ef2aea187086982bfa4, user_id=1840802affbc40e0a608d8ddf94aed69, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:43.392928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.539302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 937/1883] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:43 2022] PUT /identity/v3/projects/728d210319a34ef2aea187086982bfa4/users/1840802affbc40e0a608d8ddf94aed69/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:43.541842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:43.565091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76c3fe-26a2-46ca-937f-601c4d75136c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:43.628716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292a1d3-027b-4ab9-8d95-eabba9caa104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:43.629510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a1d3-027b-4ab9-8d95-eabba9caa104 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.629910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a1d3-027b-4ab9-8d95-eabba9caa104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.630257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a1d3-027b-4ab9-8d95-eabba9caa104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.631099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292a1d3-027b-4ab9-8d95-eabba9caa104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:43.633370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292a1d3-027b-4ab9-8d95-eabba9caa104 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.648488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 947/1884] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:43.653479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:43.665823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f862-c6dc-45d8-af26-e19efb6ee915 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:43.671489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:43.672438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.672727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.682917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] PATH_INFO: `/v3/projects/728d210319a34ef2aea187086982bfa4/users/1840802affbc40e0a608d8ddf94aed69/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.682917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=728d210319a34ef2aea187086982bfa4, user_id=1840802affbc40e0a608d8ddf94aed69, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:43.682917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.689741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 938/1885] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:43 2022] PUT /identity/v3/projects/728d210319a34ef2aea187086982bfa4/users/1840802affbc40e0a608d8ddf94aed69/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:43.701581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.701880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.702165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.731550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] MFA Rules not processed for user `1840802affbc40e0a608d8ddf94aed69`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:43.732780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:43.804427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 948/1886] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:43.818130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:43.879595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee8c7-1954-439f-a430-cc94d0b4bdeb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:43.883886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1b6cb-c4ce-4955-8a69-2ece72a8a7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:43.884560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1b6cb-c4ce-4955-8a69-2ece72a8a7df service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:43.885201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1b6cb-c4ce-4955-8a69-2ece72a8a7df service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:43.885627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1b6cb-c4ce-4955-8a69-2ece72a8a7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:43.896158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1b6cb-c4ce-4955-8a69-2ece72a8a7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:43.901976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1b6cb-c4ce-4955-8a69-2ece72a8a7df service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:43.911563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 939/1887] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:43.946014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:44.028887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70dfa5-3810-46f4-9824-5923591f9e0e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:44.034198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:44.037795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:44.037795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:44.037795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] PATH_INFO: `/v3/users/e4d3e3320d3449be822c5f9170e16219` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:44.037795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d3e3320d3449be822c5f9170e16219)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:44.039201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:44.288718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d3e3320d3449be822c5f9170e16219'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:44.300670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d3e3320d3449be822c5f9170e16219'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:44.301357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d3e3320d3449be822c5f9170e16219'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:44.301996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d3e3320d3449be822c5f9170e16219'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:44.404456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d3e3320d3449be822c5f9170e16219'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:44.419387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 949/1888] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:43 2022] DELETE /identity/v3/users/e4d3e3320d3449be822c5f9170e16219 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:44.424319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:44.424814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:44.424902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:44.444798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:44.446003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:44.525758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 940/1889] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:44.535408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:44.536844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:44.594538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5d7f-3c96-4afa-adc1-c384f737f167 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:44.598467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:44.599113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:44.599449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:44.599729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:44.610007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:44.611455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:44.620939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 950/1890] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:45.110808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:45.112253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:45.125132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3c2a-d7db-47cb-a835-57281c6cd65b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:45.131625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:45.132638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:45.132930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:45.133211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] PATH_INFO: `/v3/projects/3f32452f4199465d9f0586c81e3f863a` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:45.134518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f32452f4199465d9f0586c81e3f863a)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:45.136495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:45.245528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f32452f4199465d9f0586c81e3f863a', 'request_id': 'req-5568e95b-ef67-4f40-a904-d6489a6e8748'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.250756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f32452f4199465d9f0586c81e3f863a', 'request_id': 'req-5568e95b-ef67-4f40-a904-d6489a6e8748'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.257056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f32452f4199465d9f0586c81e3f863a', 'request_id': 'req-5568e95b-ef67-4f40-a904-d6489a6e8748'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.393237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] The token cache is being invalidate because project 3f32452f4199465d9f0586c81e3f863a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:45.393526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.394182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.400182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 941/1891] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:45 2022] DELETE /identity/v3/projects/3f32452f4199465d9f0586c81e3f863a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:45.400361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:45.410016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147333e-a9ad-4059-96b8-9c6ebd097497 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:45.464785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:45.465573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:45.465853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:45.466129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] PATH_INFO: `/v3/users/1840802affbc40e0a608d8ddf94aed69` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:45.467422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1840802affbc40e0a608d8ddf94aed69)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:45.469420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:45.849139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1840802affbc40e0a608d8ddf94aed69'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.860698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1840802affbc40e0a608d8ddf94aed69'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.861347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1840802affbc40e0a608d8ddf94aed69'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:45.861935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1840802affbc40e0a608d8ddf94aed69'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.050472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-29369a71-9e85-495d-b37e-a6a8fa71a195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1840802affbc40e0a608d8ddf94aed69'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.063936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 951/1892] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:45 2022] DELETE /identity/v3/users/1840802affbc40e0a608d8ddf94aed69 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:46.574013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:46.575474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:46.589550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568e95b-ef67-4f40-a904-d6489a6e8748 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:46.651093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:46.651984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:46.653339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:46.653339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] PATH_INFO: `/v3/projects/728d210319a34ef2aea187086982bfa4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:46.653997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=728d210319a34ef2aea187086982bfa4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:46.656196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:46.753460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728d210319a34ef2aea187086982bfa4', 'request_id': 'req-6bb5ea09-343a-4996-9a24-947f8305ca90'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.759278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728d210319a34ef2aea187086982bfa4', 'request_id': 'req-6bb5ea09-343a-4996-9a24-947f8305ca90'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.765365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728d210319a34ef2aea187086982bfa4', 'request_id': 'req-6bb5ea09-343a-4996-9a24-947f8305ca90'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.858561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] The token cache is being invalidate because project 728d210319a34ef2aea187086982bfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:46.858783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.859525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-6bb5ea09-343a-4996-9a24-947f8305ca90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:46.861432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 942/1893] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:46 2022] DELETE /identity/v3/projects/728d210319a34ef2aea187086982bfa4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:46.866916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:46.867402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:46.867620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:46.885698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:46.886891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:46.944524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 952/1894] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:46.952404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191590c-035c-4e59-a217-84019d563de8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:46.952722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191590c-035c-4e59-a217-84019d563de8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:46.953004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191590c-035c-4e59-a217-84019d563de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:46.972064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-7191590c-035c-4e59-a217-84019d563de8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:46.973258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-7191590c-035c-4e59-a217-84019d563de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:46.982273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 943/1895] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:46.986443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:46.996290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8412c-cda4-4526-bc65-dd90c79b7a3e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.000914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.001690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.001871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.002127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.002849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:47.003151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.004772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.016671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 953/1896] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:47.020743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191590c-035c-4e59-a217-84019d563de8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.030550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191590c-035c-4e59-a217-84019d563de8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.035165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.035836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.036118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.036396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.037082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.039833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.188639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 944/1897] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:47 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:47.190151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.204360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3203e27-f308-4a41-b835-0f7263ac612a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.265512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.266232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.266520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.266792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.267533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.269575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.378699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 954/1898] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:47 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:47.383692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.393864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119bf9-d252-4453-85d5-25b1ff915f58 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.398669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.399362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.399643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.399919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.400641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.402227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.413675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 945/1899] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:47.417570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.427363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e104a-a4a8-40e8-9c99-02c5164fc9ca admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.432522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10cfa2-f3d2-42a2-b1ed-71a1c7aae384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.433189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10cfa2-f3d2-42a2-b1ed-71a1c7aae384 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.433626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10cfa2-f3d2-42a2-b1ed-71a1c7aae384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.433886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10cfa2-f3d2-42a2-b1ed-71a1c7aae384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.434758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10cfa2-f3d2-42a2-b1ed-71a1c7aae384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.436373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10cfa2-f3d2-42a2-b1ed-71a1c7aae384 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.450102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 955/1900] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:28:47.451387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.464394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cc89b-c555-467d-8f28-8d297b56ea45 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.469712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.470849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.471128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.471471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] PATH_INFO: `/v3/projects/83f4ae0afca5467f84451948f42c41d8/users/88e84b517fa34bde9d3f0d3bca2e6314/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.488947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f4ae0afca5467f84451948f42c41d8, user_id=88e84b517fa34bde9d3f0d3bca2e6314, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.492146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.607655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 946/1901] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:47 2022] PUT /identity/v3/projects/83f4ae0afca5467f84451948f42c41d8/users/88e84b517fa34bde9d3f0d3bca2e6314/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:47.618992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.619309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.619590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.648991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] MFA Rules not processed for user `88e84b517fa34bde9d3f0d3bca2e6314`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:47.650668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:47.729134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 956/1902] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:47.733383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.799990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dccff-566a-4804-b4af-7b9f137d05bb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.805281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.805963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.806261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.806568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.807284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.809192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:47.905182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 947/1903] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:47 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:47.910022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:47.921687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42291-bcc0-485b-9dab-0f5648fb22f3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:47.979247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:47.980016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:47.980289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:47.980572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:47.981265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:47.983192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.073658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 957/1904] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:47 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:48.077525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.087993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e913f5-38a9-40e3-b6e4-270314479c65 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.092998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ec2c-373b-4b16-a2ef-a01073efbed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.093788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ec2c-373b-4b16-a2ef-a01073efbed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.094045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ec2c-373b-4b16-a2ef-a01073efbed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.094416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ec2c-373b-4b16-a2ef-a01073efbed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.095496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ec2c-373b-4b16-a2ef-a01073efbed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.097207 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ec2c-373b-4b16-a2ef-a01073efbed5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.108993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 948/1905] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:28:48.115905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.127078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2fac-786e-4035-bb8c-8f120f0b82dc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.132082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.133094 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.133432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.134130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] PATH_INFO: `/v3/projects/1977299eb5a14c89bd308b00ca052d56/users/9e36f60bd55a426fbf0095a6a1a93151/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.135673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04d9d-ebb6-45eb-afd8-637e31a1a694 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.135978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04d9d-ebb6-45eb-afd8-637e31a1a694 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.136407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04d9d-ebb6-45eb-afd8-637e31a1a694 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.138146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 949/1906] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:28:48.148637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.149168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.149457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.150823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1977299eb5a14c89bd308b00ca052d56, user_id=9e36f60bd55a426fbf0095a6a1a93151, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.154538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.169423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:48.170695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:48.241298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 950/1907] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:48.252485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 958/1908] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:48 2022] PUT /identity/v3/projects/1977299eb5a14c89bd308b00ca052d56/users/9e36f60bd55a426fbf0095a6a1a93151/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:48.256799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.262191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.264130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:48.271637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fcb8c-c658-4629-84d1-ca9c8722f4c3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.334210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.334883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.335167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.336116 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.336959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.338566 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.352499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 951/1909] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:48.352786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578018d3-fd3b-41f2-ad21-b9a1a6ff9bd7 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.353889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.357652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f84c1-7b6b-4287-9918-4c0e014ad3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.360388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f84c1-7b6b-4287-9918-4c0e014ad3f5 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.360388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f84c1-7b6b-4287-9918-4c0e014ad3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.360388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f84c1-7b6b-4287-9918-4c0e014ad3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.364010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50f26a-42c7-4882-bbf8-c3498c5517fe admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.369048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.369188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f84c1-7b6b-4287-9918-4c0e014ad3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.370087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.370423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.370702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] PATH_INFO: `/v3/projects/1977299eb5a14c89bd308b00ca052d56/users/9e36f60bd55a426fbf0095a6a1a93151/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.370837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f84c1-7b6b-4287-9918-4c0e014ad3f5 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.372709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1977299eb5a14c89bd308b00ca052d56, user_id=9e36f60bd55a426fbf0095a6a1a93151, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.375365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.381098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 959/1910] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:48.386086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 952/1911] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:48 2022] PUT /identity/v3/projects/1977299eb5a14c89bd308b00ca052d56/users/9e36f60bd55a426fbf0095a6a1a93151/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:48.397529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.398331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.398665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.425250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] MFA Rules not processed for user `9e36f60bd55a426fbf0095a6a1a93151`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:48.426445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:48.495726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 960/1912] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:48.515696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.517604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:48.618521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501616e8-0a48-4ccb-8b3c-a9f8b6366868 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.622907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce153-baab-4f04-8d87-be7fdb36e61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.625160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce153-baab-4f04-8d87-be7fdb36e61f service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.625160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce153-baab-4f04-8d87-be7fdb36e61f service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.625160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce153-baab-4f04-8d87-be7fdb36e61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.637002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce153-baab-4f04-8d87-be7fdb36e61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.638744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce153-baab-4f04-8d87-be7fdb36e61f service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:48.650733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 953/1913] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:48.771546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:48.881425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b29e0-2ea5-4fe7-8e41-c04766c844c1 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:48.889383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:48.891914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:48.892344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:48.895182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] PATH_INFO: `/v3/users/88e84b517fa34bde9d3f0d3bca2e6314` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:48.895182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e84b517fa34bde9d3f0d3bca2e6314)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:48.896507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:49.162953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e84b517fa34bde9d3f0d3bca2e6314'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:49.175360 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e84b517fa34bde9d3f0d3bca2e6314'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:49.176147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e84b517fa34bde9d3f0d3bca2e6314'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:49.176761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e84b517fa34bde9d3f0d3bca2e6314'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:49.308671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e84b517fa34bde9d3f0d3bca2e6314'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:49.321137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 961/1914] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:48 2022] DELETE /identity/v3/users/88e84b517fa34bde9d3f0d3bca2e6314 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:49.325589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:49.325873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:49.326146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:49.342983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:49.347940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:49.409208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 954/1915] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:49.420760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:49.422438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:49.490918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c02b5-0bf3-4338-8973-0d28bd4f0653 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:49.490918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:49.490918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:49.490918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:49.491315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:49.496443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:49.497848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:49.513829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 962/1916] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:50.059172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:50.061230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:50.080370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321e3a-fb40-4f39-8411-6bf9c3037dad None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:50.086990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:50.096424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:50.096760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:50.097109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] PATH_INFO: `/v3/projects/83f4ae0afca5467f84451948f42c41d8` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:50.098477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f4ae0afca5467f84451948f42c41d8)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:50.100601 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:50.235399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f4ae0afca5467f84451948f42c41d8', 'request_id': 'req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.241040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f4ae0afca5467f84451948f42c41d8', 'request_id': 'req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.247603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f4ae0afca5467f84451948f42c41d8', 'request_id': 'req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.312993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] The token cache is being invalidate because project 83f4ae0afca5467f84451948f42c41d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:50.313277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.314119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.315936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 955/1917] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:50 2022] DELETE /identity/v3/projects/83f4ae0afca5467f84451948f42c41d8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:50.320566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:50.332607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c8f3a-da84-44d2-bbe0-e2cccf577196 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:50.396762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:50.397894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:50.398685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:50.398988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] PATH_INFO: `/v3/users/9e36f60bd55a426fbf0095a6a1a93151` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:50.400362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e36f60bd55a426fbf0095a6a1a93151)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:50.404841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:50.578472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e36f60bd55a426fbf0095a6a1a93151'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.590108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e36f60bd55a426fbf0095a6a1a93151'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.590791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e36f60bd55a426fbf0095a6a1a93151'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.591409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e36f60bd55a426fbf0095a6a1a93151'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.696390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-478e06f8-fd06-4953-9a98-c72ee2022d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e36f60bd55a426fbf0095a6a1a93151'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:50.709242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 963/1918] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:50 2022] DELETE /identity/v3/users/9e36f60bd55a426fbf0095a6a1a93151 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:51.340862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:51.342387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:51.356372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36fdfc-0c9b-44f2-a2e5-392e31be7282 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:51.429101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:51.431560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:51.431560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:51.431560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] PATH_INFO: `/v3/projects/1977299eb5a14c89bd308b00ca052d56` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:51.431903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1977299eb5a14c89bd308b00ca052d56)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:51.433813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:51.557924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1977299eb5a14c89bd308b00ca052d56', 'request_id': 'req-579ef479-9f6a-4280-ab46-e8ecd1124cc7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:51.563141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1977299eb5a14c89bd308b00ca052d56', 'request_id': 'req-579ef479-9f6a-4280-ab46-e8ecd1124cc7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:51.570236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1977299eb5a14c89bd308b00ca052d56', 'request_id': 'req-579ef479-9f6a-4280-ab46-e8ecd1124cc7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:51.639104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] The token cache is being invalidate because project 1977299eb5a14c89bd308b00ca052d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:51.639427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:51.640077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-579ef479-9f6a-4280-ab46-e8ecd1124cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:51.641613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 956/1919] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:51 2022] DELETE /identity/v3/projects/1977299eb5a14c89bd308b00ca052d56 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:51.646897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:51.647386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:51.647563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:51.665494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:51.666693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:51.724663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 964/1920] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:51.732681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:51.733054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:51.733410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:51.752114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:51.753320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:51.766720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 957/1921] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:51.767894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:51.778767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9f06-9be1-4b57-95b1-39b475e15f32 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:51.783618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:51.784370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:51.784546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:51.784902 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:51.785691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:51.786004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:51.787692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:51.799671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 965/1922] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:51.804171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:51.813655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629bda-e833-4664-bc5b-f5d984f92f1b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:51.818698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:51.819382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:51.820174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:51.820457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:51.821175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:51.823081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:51.942192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 958/1923] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:51 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:51.946829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:51.956904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72681e00-c6ad-427e-84f1-8d289839952a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.012080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.012744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.013030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.013312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.014039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.016012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.095309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 966/1924] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:51 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:52.099177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.109415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45068b-59ac-4e50-9374-26af0ac0fa97 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.113982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.114664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.114946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.115219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.117435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.118464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.128569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 959/1925] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:52.133102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.142883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e95e-df00-4dcd-a158-7bfcf7817f75 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.147478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3fb5b-1e84-46dc-8d5d-67eaa4a4cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.148131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fb5b-1e84-46dc-8d5d-67eaa4a4cd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.148413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fb5b-1e84-46dc-8d5d-67eaa4a4cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.148690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fb5b-1e84-46dc-8d5d-67eaa4a4cd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.149407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fb5b-1e84-46dc-8d5d-67eaa4a4cd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.151015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fb5b-1e84-46dc-8d5d-67eaa4a4cd17 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.160537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 967/1926] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:52.164769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.174664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e58df-6e4c-4add-ad73-ce6991f03200 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.180032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.180930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.181216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.181496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] PATH_INFO: `/v3/projects/a6aa10b52c97468eb2f5658aef9fd8f8/users/7abbf25fe56b4e16822c25f37281a82a/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.196205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6aa10b52c97468eb2f5658aef9fd8f8, user_id=7abbf25fe56b4e16822c25f37281a82a, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.198829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.311278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 960/1927] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:52 2022] PUT /identity/v3/projects/a6aa10b52c97468eb2f5658aef9fd8f8/users/7abbf25fe56b4e16822c25f37281a82a/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:52.322394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.322765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.323113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.351216 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] MFA Rules not processed for user `7abbf25fe56b4e16822c25f37281a82a`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:52.352767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:52.425534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 968/1928] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:52.430389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.508516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b304f-773b-44b9-b600-0a8f7a00f9a7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.535635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.536859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.539239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.539558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.541819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.546348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.648784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 961/1929] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:52 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:52.652903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.665764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddeb2f-4b7c-4be0-be42-161aa637efd0 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.738911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.739637 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.739922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.740200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.740904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.743236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.897211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 969/1930] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:52 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:52.901945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.912090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63522d7-8393-4417-b981-d014052b215d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.917328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.917982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.918266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.918541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.919274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.920874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:52.931262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 962/1931] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:52.935300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:52.945530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da763d6-fcd8-483e-afd8-8a1d5adf8967 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:52.950199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:52.951104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:52.951424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:52.953827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] PATH_INFO: `/v3/projects/54397fadd6c14fceb611f106add93ae2/users/21a6696bcea24aea81aed6b568f9fdea/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:52.967159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54397fadd6c14fceb611f106add93ae2, user_id=21a6696bcea24aea81aed6b568f9fdea, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:52.970193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.057480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 970/1932] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:52 2022] PUT /identity/v3/projects/54397fadd6c14fceb611f106add93ae2/users/21a6696bcea24aea81aed6b568f9fdea/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:53.061407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:53.071947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07137-134d-4388-abfe-0ef527f77e91 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:53.128091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb97a5-4b28-45a6-8647-20c8cc1dbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:53.128680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb97a5-4b28-45a6-8647-20c8cc1dbd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.128965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb97a5-4b28-45a6-8647-20c8cc1dbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.129241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb97a5-4b28-45a6-8647-20c8cc1dbd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.129992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb97a5-4b28-45a6-8647-20c8cc1dbd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:53.131628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb97a5-4b28-45a6-8647-20c8cc1dbd9d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.143059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 963/1933] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:53.146138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:53.157656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716c4b2-497c-47af-aebe-18ba3121999b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:53.162423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:53.163334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.163627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.163903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] PATH_INFO: `/v3/projects/54397fadd6c14fceb611f106add93ae2/users/21a6696bcea24aea81aed6b568f9fdea/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.167020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54397fadd6c14fceb611f106add93ae2, user_id=21a6696bcea24aea81aed6b568f9fdea, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:53.169078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.179359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 971/1934] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:53 2022] PUT /identity/v3/projects/54397fadd6c14fceb611f106add93ae2/users/21a6696bcea24aea81aed6b568f9fdea/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:53.190553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.190847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.191129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.218693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] MFA Rules not processed for user `21a6696bcea24aea81aed6b568f9fdea`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:53.220203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:53.279922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:53.281662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:53.290865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 964/1935] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:53.301733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:53.303131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:53.348253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe746-e104-4a77-a884-c9adde811f35 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:53.353120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:53.353994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.354278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.354584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] PATH_INFO: `/v3/users/b1c3afa1772f4153ad8dce026c992b3d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.355870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c3afa1772f4153ad8dce026c992b3d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:53.357807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.360777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd3ac9-1a3f-43a3-a557-efff8fbd0243 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:53.364394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:53.365029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.365314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.365592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.375172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:53.376603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.386974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 965/1936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:28:53.434887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:53.436300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:53.448316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238179a0-50e8-4f11-95e6-b32bb8fd6ca9 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:53.452126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c53a4-8c0f-4b20-8bda-4bb173fddd3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:53.452760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c53a4-8c0f-4b20-8bda-4bb173fddd3c service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.453073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c53a4-8c0f-4b20-8bda-4bb173fddd3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.453349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c53a4-8c0f-4b20-8bda-4bb173fddd3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.510766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c53a4-8c0f-4b20-8bda-4bb173fddd3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:53.512261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c53a4-8c0f-4b20-8bda-4bb173fddd3c service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.521445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 966/1937] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:28:53.538940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c3afa1772f4153ad8dce026c992b3d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:53.550457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c3afa1772f4153ad8dce026c992b3d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:53.551150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c3afa1772f4153ad8dce026c992b3d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:53.551947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c3afa1772f4153ad8dce026c992b3d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:53.611620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c3afa1772f4153ad8dce026c992b3d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:53.625873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 972/1938] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:53 2022] DELETE /identity/v3/users/b1c3afa1772f4153ad8dce026c992b3d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:53.630659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.630955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.631597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.653535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:53.654783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:53.725037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 967/1939] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:53.737058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:53.739379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:53.813784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cefd6-a172-4096-a7e7-b6a3c84348af admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:53.817527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:53.818176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:53.818462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:53.818737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:53.831040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:53.832554 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:53.844358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 973/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:54.397641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:54.398963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:54.415618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c318c-a0fb-44c5-b674-2c697750cc33 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:54.420791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:54.422541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:54.423658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:54.424312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] PATH_INFO: `/v3/projects/6635421862ac49548fbcb0108de808ee` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:54.425963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6635421862ac49548fbcb0108de808ee)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:54.428575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:54.533501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6635421862ac49548fbcb0108de808ee', 'request_id': 'req-f298993e-81b9-40eb-b55c-a3a7ef74deb7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.538576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6635421862ac49548fbcb0108de808ee', 'request_id': 'req-f298993e-81b9-40eb-b55c-a3a7ef74deb7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.545971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6635421862ac49548fbcb0108de808ee', 'request_id': 'req-f298993e-81b9-40eb-b55c-a3a7ef74deb7'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.616941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] The token cache is being invalidate because project 6635421862ac49548fbcb0108de808ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:54.617337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.618180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.619785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 968/1941] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:54 2022] DELETE /identity/v3/projects/6635421862ac49548fbcb0108de808ee => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:54.623648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:54.623869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:54.625138 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:54.633375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b4b6b-a940-4d5c-ad89-28111545c051 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:54.684605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298993e-81b9-40eb-b55c-a3a7ef74deb7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:54.689289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:54.690168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:54.690971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:54.691352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:54.694987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:54.697596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:54.698711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:54.698941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:54.699287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] PATH_INFO: `/v3/users/1f86bf21154f40aba107a8ce33821a50` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:54.700533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f86bf21154f40aba107a8ce33821a50)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:54.702613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:54.769193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:54.770624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:54.781003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 969/1942] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:28:54.974564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f86bf21154f40aba107a8ce33821a50'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.988331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f86bf21154f40aba107a8ce33821a50'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.989284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f86bf21154f40aba107a8ce33821a50'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:54.990163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f86bf21154f40aba107a8ce33821a50'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.122741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-252ca86f-5b2d-435b-9336-9f18a346b37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f86bf21154f40aba107a8ce33821a50'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.138894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 974/1943] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:28:54 2022] DELETE /identity/v3/users/1f86bf21154f40aba107a8ce33821a50 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:55.584130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:55.585553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:55.600208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188e9a5-f9ca-4553-872c-75a56223eb8c service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:55.658994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:55.659890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:55.660176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:55.660454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] PATH_INFO: `/v3/projects/e3918bc393af492bbfd0e584619dabe6` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:55.661660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3918bc393af492bbfd0e584619dabe6)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:55.663583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:55.810542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3918bc393af492bbfd0e584619dabe6', 'request_id': 'req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.816019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3918bc393af492bbfd0e584619dabe6', 'request_id': 'req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.822470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3918bc393af492bbfd0e584619dabe6', 'request_id': 'req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.924826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] The token cache is being invalidate because project e3918bc393af492bbfd0e584619dabe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:28:55.925122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.925752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1528c9ce-3f4a-4aee-aaa4-54f54ca41387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:28:55.927439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 970/1944] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:28:55 2022] DELETE /identity/v3/projects/e3918bc393af492bbfd0e584619dabe6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:55.932877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:55.933168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:55.933450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:55.951388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:55.952585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:56.011962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 975/1945] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:56.019877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.020110 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.020391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.039747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:56.041336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:56.049946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 971/1946] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:56.058436 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.068271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06c31-ab13-48bb-bebd-91742136c973 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.073796 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.074451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.074741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.075034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.075778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:28:56.076085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.077664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.089986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 976/1947] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:28:56.094278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.103836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8fafe-d3e5-4b8a-929f-90db5f47ab9c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.108528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.109170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.109451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.109727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.110402 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.112310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.201089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 972/1948] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:56 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:56.205509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.216308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fa34a-583b-4307-9a79-335c7b871e20 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.275947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.276540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.276825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.277102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.277800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.279767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.349209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 977/1949] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:56 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:56.354027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.365409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dbaca-5449-4e4f-8176-43cf652498dd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.370581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.371361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.371714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.372062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.372860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.374562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.386062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 973/1950] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:56.390326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.401341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac131-856b-4716-be7e-d00b3e376082 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.406314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f61c6d-1237-4849-a58b-d11c0f7d730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.406957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f61c6d-1237-4849-a58b-d11c0f7d730b admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.407241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f61c6d-1237-4849-a58b-d11c0f7d730b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.407546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f61c6d-1237-4849-a58b-d11c0f7d730b admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.408270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f61c6d-1237-4849-a58b-d11c0f7d730b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.409906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f61c6d-1237-4849-a58b-d11c0f7d730b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.423599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 978/1951] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:56.425234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.439821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940fda-4cde-4db5-b216-ff2e4a059acc admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.445246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.446814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.447040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.447350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] PATH_INFO: `/v3/projects/ebb9e162601e48fe878ff2154a927773/users/21b255e9a5614f62b3950a7f4f62b415/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.462560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb9e162601e48fe878ff2154a927773, user_id=21b255e9a5614f62b3950a7f4f62b415, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.465228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.571995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 974/1952] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:56 2022] PUT /identity/v3/projects/ebb9e162601e48fe878ff2154a927773/users/21b255e9a5614f62b3950a7f4f62b415/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:56.582394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.582692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.583182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.610309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] MFA Rules not processed for user `21b255e9a5614f62b3950a7f4f62b415`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:56.611618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:56.673715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 979/1953] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:56.678351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.742201 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee2937-8a22-4892-8aad-15d7d77aa8ff admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.747721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.748378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.748659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.748961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.749642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.751643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:56.864568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 975/1954] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:56 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:56.869511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:56.880493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01609f-6905-4c02-ac7a-17fb8ca1fff5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:56.934797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:56.935488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:56.935772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:56.936047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:56.936727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:56.938631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.057632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 980/1955] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:56 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:57.061742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.072204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d3eda-00d9-42b9-97b4-52f59a9e54f8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.076822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.077479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.077764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.078046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.078764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.080389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.091196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 976/1956] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:57.095246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.105736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6654e-6e6d-4342-b201-fe2adac7936e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.110327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856f2ff-c10b-4c8f-9856-9513cda1f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.110985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f2ff-c10b-4c8f-9856-9513cda1f2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.111284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f2ff-c10b-4c8f-9856-9513cda1f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.111568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f2ff-c10b-4c8f-9856-9513cda1f2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.112288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856f2ff-c10b-4c8f-9856-9513cda1f2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.113868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856f2ff-c10b-4c8f-9856-9513cda1f2c7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.125060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 981/1957] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:57.129294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.139379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4eaa1-e8c5-45b4-86c4-5e988a54a04c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.143979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.144854 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.145135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.145409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] PATH_INFO: `/v3/projects/2a1332a1422949e09706d52466623cad/users/49a9c2dcea6f44ada511174fd397c62c/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.159701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1332a1422949e09706d52466623cad, user_id=49a9c2dcea6f44ada511174fd397c62c, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.162326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.274640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 977/1958] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:57 2022] PUT /identity/v3/projects/2a1332a1422949e09706d52466623cad/users/49a9c2dcea6f44ada511174fd397c62c/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:28:57.286163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.286448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.286725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.312737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] MFA Rules not processed for user `49a9c2dcea6f44ada511174fd397c62c`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:57.313854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:57.378384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 982/1959] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:28:57.382967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.443304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0208-a735-4c4b-9583-6ca8ee81921f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.448034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.448689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.448970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.449244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.449923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.451839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.602801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 978/1960] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:28:57 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:28:57.604269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.615324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529386-1e11-4bce-a050-b548a34c04ea None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.676215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.676886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.677183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.677484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.678243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.680112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.765430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 983/1961] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:28:57 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:28:57.769565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.780911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4784ab-5933-4a9e-bf76-a74e21795e34 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.786033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.786711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.786998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.787304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.788047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.789767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.801947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 979/1962] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:57.806526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.817416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab79f3-eec6-4f1f-a508-2183238b222a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:57.822848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:57.823899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:57.824202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:57.824565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] PATH_INFO: `/v3/projects/febd80d668bd4dfe9de3ff18a59221dc/users/e3a559f744554520aa9fd153cd6e5c0d/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:57.840550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febd80d668bd4dfe9de3ff18a59221dc, user_id=e3a559f744554520aa9fd153cd6e5c0d, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:57.843278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:57.959702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 984/1963] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:57 2022] PUT /identity/v3/projects/febd80d668bd4dfe9de3ff18a59221dc/users/e3a559f744554520aa9fd153cd6e5c0d/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:57.963907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:57.974161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ee1a4-374e-4fe5-9ba9-c67513fbc152 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:58.029885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed83a6-50d3-466b-87aa-a342a1e12817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:58.030544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed83a6-50d3-466b-87aa-a342a1e12817 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:58.030829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed83a6-50d3-466b-87aa-a342a1e12817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:58.031108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed83a6-50d3-466b-87aa-a342a1e12817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:58.031849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed83a6-50d3-466b-87aa-a342a1e12817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:58.033444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed83a6-50d3-466b-87aa-a342a1e12817 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:58.043003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 980/1964] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:28:58.047196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:58.058008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1c09-3a2b-473a-bf3e-e833fd013ee6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:58.062672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:58.063588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:58.063872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:58.064151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] PATH_INFO: `/v3/projects/febd80d668bd4dfe9de3ff18a59221dc/users/e3a559f744554520aa9fd153cd6e5c0d/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:58.066109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] RBAC: Authorizing `identity:create_grant(project_id=febd80d668bd4dfe9de3ff18a59221dc, user_id=e3a559f744554520aa9fd153cd6e5c0d, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:58.068767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:58.079275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 985/1965] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:28:58 2022] PUT /identity/v3/projects/febd80d668bd4dfe9de3ff18a59221dc/users/e3a559f744554520aa9fd153cd6e5c0d/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:28:58.089368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:58.089667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:58.089954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:58.116486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] MFA Rules not processed for user `e3a559f744554520aa9fd153cd6e5c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:28:58.118197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:58.185790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 981/1966] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:28:58.197356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:58.199142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:58.254834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8885f-08b6-4562-9b71-3ea33ece649e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:58.259388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:58.260034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:58.260322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:58.260602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:58.270086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:58.271574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:58.281037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 986/1967] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:28:59.373506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:28:59.374901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:28:59.386800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274edaa9-9ce4-4353-a6ab-24f7069ca15d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:28:59.390405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3e39-ab50-4e86-bb00-fded0302a1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:28:59.391052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3e39-ab50-4e86-bb00-fded0302a1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:28:59.391370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3e39-ab50-4e86-bb00-fded0302a1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:28:59.391653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3e39-ab50-4e86-bb00-fded0302a1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:28:59.448380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3e39-ab50-4e86-bb00-fded0302a1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:28:59.449812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3e39-ab50-4e86-bb00-fded0302a1d2 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:28:59.458846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 982/1968] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:28:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:06.572584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:06.574257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:06.729950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b694357-14ed-425d-9a7e-be49e42979c3 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:06.745318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:06.746275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:06.746693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:06.746974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] PATH_INFO: `/v3/users/5c6557583f224c0c83f3148c92a76163` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:06.749928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6557583f224c0c83f3148c92a76163)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:06.752664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:07.878275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6557583f224c0c83f3148c92a76163'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:07.890301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6557583f224c0c83f3148c92a76163'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:07.891080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6557583f224c0c83f3148c92a76163'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:07.891626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6557583f224c0c83f3148c92a76163'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:08.091946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6557583f224c0c83f3148c92a76163'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:08.106297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 987/1969] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:06 2022] DELETE /identity/v3/users/5c6557583f224c0c83f3148c92a76163 => generated 0 bytes in 1534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:08.115056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:08.115056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:08.115056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:08.131066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:08.132306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:08.192407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 983/1970] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:08.202482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:08.203977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:08.266700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a280-cb29-451e-8514-d855634a722c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:08.273921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589ba17-4a8b-4967-9978-c1017c67f5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:08.273921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ba17-4a8b-4967-9978-c1017c67f5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:08.273921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ba17-4a8b-4967-9978-c1017c67f5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:08.273921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589ba17-4a8b-4967-9978-c1017c67f5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:08.289153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ba17-4a8b-4967-9978-c1017c67f5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:08.289153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589ba17-4a8b-4967-9978-c1017c67f5e5 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:08.308181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 988/1971] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:08.746279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:08.747685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:08.760082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b12e-bf7b-4292-b3dc-14a1c5565790 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:08.781825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:08.783800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:08.784135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:08.784670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] PATH_INFO: `/v3/projects/6598813cf61146b2b1b591fd04b70d74` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:08.786605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6598813cf61146b2b1b591fd04b70d74)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:08.789173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:08.965206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6598813cf61146b2b1b591fd04b70d74', 'request_id': 'req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:08.972773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6598813cf61146b2b1b591fd04b70d74', 'request_id': 'req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:08.981111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6598813cf61146b2b1b591fd04b70d74', 'request_id': 'req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:09.113559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] The token cache is being invalidate because project 6598813cf61146b2b1b591fd04b70d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:09.114209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:09.115088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0ca4fb5c-6ba9-4ef4-8be5-c160cb974805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:09.117576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 984/1972] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:08 2022] DELETE /identity/v3/projects/6598813cf61146b2b1b591fd04b70d74 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:09.124213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.124762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.124933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.146918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:09.149171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:09.245696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 989/1973] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:09.254202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.254970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.255512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.302916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:09.307698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:09.316848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 985/1974] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:09.321580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:09.336657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c308f-0231-44fb-b6e7-123bf1088338 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:09.344349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:09.344349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.344349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.344663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.345401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:09.345705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:09.347318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:09.361049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 990/1975] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:09.365358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:09.378659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d82c05-b59c-46b8-9953-f6452d1fce6b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:09.380273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:09.380961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.381244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.381526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.382219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:09.384160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:09.545550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 986/1976] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:09 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:09.556755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:09.561772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277987-dae8-4b62-8bc8-fb0ae55e5c74 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:09.627331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:09.628022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.628308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.628734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.629486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:09.631477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:09.761528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 991/1977] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:09 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:09.769051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:09.786874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d0a1-23a6-4d1b-84cb-25c6f0f7b4db admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:09.791774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:09.792678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.793022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.793381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.794169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:09.795912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:09.810573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 987/1978] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:09.814879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:09.826679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f20c-34dc-48aa-b2be-dfec4f683b3b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:09.831699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d4008-28fd-4a2f-aa98-cb0851bc2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:09.832553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d4008-28fd-4a2f-aa98-cb0851bc2587 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.832706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d4008-28fd-4a2f-aa98-cb0851bc2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.832994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d4008-28fd-4a2f-aa98-cb0851bc2587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.833722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d4008-28fd-4a2f-aa98-cb0851bc2587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:09.835356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d4008-28fd-4a2f-aa98-cb0851bc2587 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:09.847590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 992/1979] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:09.852118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:09.863197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8dcb7-c7fc-4cd2-840d-40d441696649 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:09.868124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:09.869027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:09.869311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:09.870117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] PATH_INFO: `/v3/projects/7647dc0792e645eb95f92dc634af9836/users/766476705b5e45d492aa02ea354e442a/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:09.885017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7647dc0792e645eb95f92dc634af9836, user_id=766476705b5e45d492aa02ea354e442a, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:09.888396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:10.007725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 988/1980] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:09 2022] PUT /identity/v3/projects/7647dc0792e645eb95f92dc634af9836/users/766476705b5e45d492aa02ea354e442a/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:10.019675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:10.020617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:10.021069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:10.055342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] MFA Rules not processed for user `766476705b5e45d492aa02ea354e442a`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:10.056661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:10.139196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 993/1981] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:10.469793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:10.471598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:10.531657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae1b1-5eb5-4bcc-ab50-2a8bdfdaddbe admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:10.536539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:10.542059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:10.542059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:10.542059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:10.551137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:10.552822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:10.564383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 989/1982] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:10.594169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:10.696842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7064-1b39-4e39-8fe2-dd8e8edacbe9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:10.702784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:10.708846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:10.708846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:10.708846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] PATH_INFO: `/v3/users/766476705b5e45d492aa02ea354e442a` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:10.708846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766476705b5e45d492aa02ea354e442a)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:10.708846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:10.710186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:10.711728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:10.740428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29348ad9-7763-447b-bf60-0fa66500d72e service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:10.746474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:10.748197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:10.748693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:10.749133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] PATH_INFO: `/v3/users/7abbf25fe56b4e16822c25f37281a82a` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:10.750384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abbf25fe56b4e16822c25f37281a82a)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:10.752622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:10.905490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766476705b5e45d492aa02ea354e442a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.917645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766476705b5e45d492aa02ea354e442a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.918351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766476705b5e45d492aa02ea354e442a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.920026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766476705b5e45d492aa02ea354e442a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.985915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abbf25fe56b4e16822c25f37281a82a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.995667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abbf25fe56b4e16822c25f37281a82a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.996388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abbf25fe56b4e16822c25f37281a82a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:10.997000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abbf25fe56b4e16822c25f37281a82a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:11.003421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-21bc23b6-abce-4bae-b026-f85f203e5b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766476705b5e45d492aa02ea354e442a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:11.009419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b0248b24-987a-4dcb-ae68-e477f894eaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abbf25fe56b4e16822c25f37281a82a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:11.018222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 994/1983] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:10 2022] DELETE /identity/v3/users/766476705b5e45d492aa02ea354e442a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:11.022709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:11.023022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:11.023338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:11.041778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:11.043068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:11.097254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 990/1984] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:10 2022] DELETE /identity/v3/users/7abbf25fe56b4e16822c25f37281a82a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:11.101793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:11.102087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:11.102371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:11.117271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 995/1985] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:11.129330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:11.131581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:11.131743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:11.132921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:11.202604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8436142-67c2-41d4-85ac-1a86e6cb86d1 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:11.204829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 991/1986] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:11.214842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:11.254306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:11.254959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:11.255348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:11.255721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:11.265605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:11.267119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:11.271723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429054e-31e3-4a46-a1bf-cba53338a6bc None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:11.275489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:11.276888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:11.277172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:11.277787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 996/1987] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:11.277902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:11.287787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:11.289228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:11.301072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 992/1988] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:11.841324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:11.844955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:11.868882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040f2d6-23dc-4662-8cc7-41c0a538def9 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:11.874041 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:11.874895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:11.875198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:11.875694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] PATH_INFO: `/v3/projects/a6aa10b52c97468eb2f5658aef9fd8f8` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:11.876861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6aa10b52c97468eb2f5658aef9fd8f8)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:11.878743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:11.898771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:11.900432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:11.921701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15959-66d2-4a68-aad9-e1d255d25679 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:11.926727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:11.927709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:11.928007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:11.928289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] PATH_INFO: `/v3/projects/7647dc0792e645eb95f92dc634af9836` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:11.929499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7647dc0792e645eb95f92dc634af9836)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:11.939421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:11.999644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6aa10b52c97468eb2f5658aef9fd8f8', 'request_id': 'req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.045239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7647dc0792e645eb95f92dc634af9836', 'request_id': 'req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.050758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7647dc0792e645eb95f92dc634af9836', 'request_id': 'req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.054294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6aa10b52c97468eb2f5658aef9fd8f8', 'request_id': 'req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.058372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7647dc0792e645eb95f92dc634af9836', 'request_id': 'req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.064447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6aa10b52c97468eb2f5658aef9fd8f8', 'request_id': 'req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.076458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] The token cache is being invalidate because project a6aa10b52c97468eb2f5658aef9fd8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:12.076752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.077422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.079213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 997/1989] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:11 2022] DELETE /identity/v3/projects/a6aa10b52c97468eb2f5658aef9fd8f8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:12.082920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.084304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:12.123420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] The token cache is being invalidate because project 7647dc0792e645eb95f92dc634af9836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:12.123757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.124346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4de9c0e8-c58f-477c-a9e2-e6b94c0f9d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.129455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 993/1990] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:11 2022] DELETE /identity/v3/projects/7647dc0792e645eb95f92dc634af9836 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:12.132904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2f402-1ac3-41f9-b96a-2617bd02ad1c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.133313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2f402-1ac3-41f9-b96a-2617bd02ad1c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.133738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2f402-1ac3-41f9-b96a-2617bd02ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.155160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8a0a-3228-47cd-bfe4-3ad35433e9ec admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.155963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b5d2f402-1ac3-41f9-b96a-2617bd02ad1c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:12.159143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b5d2f402-1ac3-41f9-b96a-2617bd02ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:12.223600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.224498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.224784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.225063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] PATH_INFO: `/v3/users/21a6696bcea24aea81aed6b568f9fdea` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.226592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a6696bcea24aea81aed6b568f9fdea)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.229510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.239514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 994/1991] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:12.241278 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.241668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.242214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.263228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:12.264434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:12.272477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 995/1992] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:12.282415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.292006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f30e7-ca26-4d0d-9d08-c23cd133898f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.296715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.297360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.297638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.297911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.298665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:12.298981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.300611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.312980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 996/1993] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:29:12.317151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.327451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282f07d-0883-4491-8178-4ad473b13915 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.332552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.334295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.334295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.334295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.334622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.336303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.429585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a6696bcea24aea81aed6b568f9fdea'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.442263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a6696bcea24aea81aed6b568f9fdea'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.442991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a6696bcea24aea81aed6b568f9fdea'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.444749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a6696bcea24aea81aed6b568f9fdea'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.452826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 997/1994] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:12 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:12.457098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.458859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:12.519133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a6696bcea24aea81aed6b568f9fdea'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:12.524962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735ada5-dc1d-49f8-9de9-0d344119b7f9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.530536 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.531204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.531516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.531792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.532083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 998/1995] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:12 2022] DELETE /identity/v3/users/21a6696bcea24aea81aed6b568f9fdea => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:12.535032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.535032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.637124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 998/1996] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:12 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:12.641304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.701285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a2133-6418-48cb-a156-b54609930451 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.706694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.707400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.707684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.707963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.708684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.710353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.724163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 999/1997] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:12.725196 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.748625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93ff5-bfb3-4f98-ac95-1a3e23e2f6a6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.753391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032dcf-c6ae-481c-9525-ad6e5b507ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.754091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032dcf-c6ae-481c-9525-ad6e5b507ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.754371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032dcf-c6ae-481c-9525-ad6e5b507ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.754648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032dcf-c6ae-481c-9525-ad6e5b507ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.755445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe032dcf-c6ae-481c-9525-ad6e5b507ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.757042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe032dcf-c6ae-481c-9525-ad6e5b507ee7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.767789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 999/1998] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:12.771754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.782032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d570a-62a2-42ee-8e8a-6a667fbe5a17 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:12.787010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:12.789288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.789288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.789288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] PATH_INFO: `/v3/projects/396b341098504bb4956262d0ae1aabc5/users/951fcc6ad18145bd9c9dbe556c1f7270/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.810521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396b341098504bb4956262d0ae1aabc5, user_id=951fcc6ad18145bd9c9dbe556c1f7270, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:12.813413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:12.889177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1000/1999] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:12 2022] PUT /identity/v3/projects/396b341098504bb4956262d0ae1aabc5/users/951fcc6ad18145bd9c9dbe556c1f7270/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:12.900345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:12.901500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:12.901805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:12.930477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] MFA Rules not processed for user `951fcc6ad18145bd9c9dbe556c1f7270`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:12.931793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:12.941287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:12.943621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:13.012750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1000/2000] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:13.016496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bfdda-38fc-4ea2-8a46-06ec00cee584 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.021324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.022268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.022556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.022835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] PATH_INFO: `/v3/projects/54397fadd6c14fceb611f106add93ae2` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.023418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.024135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54397fadd6c14fceb611f106add93ae2)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.024749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:13.026935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.082463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1686-f65f-4ca7-814a-b076af8495e0 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.085981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda162c-6356-4b8c-9e3b-51828aac613a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.086617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda162c-6356-4b8c-9e3b-51828aac613a service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.086951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda162c-6356-4b8c-9e3b-51828aac613a service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.087532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda162c-6356-4b8c-9e3b-51828aac613a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.096259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda162c-6356-4b8c-9e3b-51828aac613a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.097668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda162c-6356-4b8c-9e3b-51828aac613a service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.106330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1001/2001] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:13.157934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54397fadd6c14fceb611f106add93ae2', 'request_id': 'req-58308a5e-db09-455f-9132-7c954bafe450'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:13.214533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54397fadd6c14fceb611f106add93ae2', 'request_id': 'req-58308a5e-db09-455f-9132-7c954bafe450'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:13.221026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54397fadd6c14fceb611f106add93ae2', 'request_id': 'req-58308a5e-db09-455f-9132-7c954bafe450'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:13.232329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] The token cache is being invalidate because project 54397fadd6c14fceb611f106add93ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:13.232993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:13.233412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-58308a5e-db09-455f-9132-7c954bafe450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:13.235000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1001/2002] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:12 2022] DELETE /identity/v3/projects/54397fadd6c14fceb611f106add93ae2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:13.240077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.240366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.242423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.259277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:13.261157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:13.324273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1002/2003] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:13.332199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.332585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.332809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.351299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:13.352523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:13.361151 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1002/2004] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:13.365264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.375735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d629984-af4a-43fa-b67c-dd0ab197a086 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.380632 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.381282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.381563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.381838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.382554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:13.382860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.384542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.396144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1003/2005] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:13.400404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.409680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa89e2-0bc7-47c5-aea2-98ebe0a3a308 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.414515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.415160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.415477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.415754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.416965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.418892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.516568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1003/2006] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:13 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:13.520701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.531661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30071-b813-4d2b-81d8-e0ada354d9b4 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.585167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.585803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.586067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.586345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.587033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.589689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.686600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1004/2007] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:13 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:13.690604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.701263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d3dc-8297-4c99-a7f7-e1c235112acf admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.706264 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.707504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.707856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.708198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.709003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.710759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.722450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1004/2008] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:13.726438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.737311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0fb05-fdd4-42db-8218-35c5d59e560f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.742189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8b12-0a92-46d2-9345-c126dc4fe054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.742843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8b12-0a92-46d2-9345-c126dc4fe054 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.743221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8b12-0a92-46d2-9345-c126dc4fe054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.743544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8b12-0a92-46d2-9345-c126dc4fe054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.744856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8b12-0a92-46d2-9345-c126dc4fe054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.746595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8b12-0a92-46d2-9345-c126dc4fe054 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.757758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1005/2009] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:13.762297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:13.772470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43ba8-8f25-40bd-9f83-472e1ac6ebb2 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:13.778280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:13.779173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.779493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.779886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] PATH_INFO: `/v3/projects/07dc5c064d4c4ce292625751b0eb39ca/users/efe249ce990a466e98f2017db24d4b58/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.795780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dc5c064d4c4ce292625751b0eb39ca, user_id=efe249ce990a466e98f2017db24d4b58, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:13.798488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:13.860714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1005/2010] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:13 2022] PUT /identity/v3/projects/07dc5c064d4c4ce292625751b0eb39ca/users/efe249ce990a466e98f2017db24d4b58/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:13.871720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:13.872017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:13.872301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:13.899907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] MFA Rules not processed for user `efe249ce990a466e98f2017db24d4b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:13.902006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:13.963675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1006/2011] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:13.968222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.031573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ce416-f257-44b5-be9c-3b6d733aa7b4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.036445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.037105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.037389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.037663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.038454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.040502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.147094 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1006/2012] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:13 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:14.149306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.160176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01e467-abac-4aa7-ad2d-632d2c1e48ee None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.214300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.214967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.215277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.215549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.216236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.218149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.322708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1007/2013] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:14 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:14.326795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.337218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cc719-d26a-41a1-8c97-a6a72c699450 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.341961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.342617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.342896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.343168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.344324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.345848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.357734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1007/2014] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:14.361873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.372520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0dd8-44d8-4d01-abd1-ff7908e844eb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.377183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.378061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.378342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.378617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] PATH_INFO: `/v3/projects/d266fdc2aa824ff99aadb84a910f1dcd/users/b45e0cb7bac5464b937e13868aacc5d3/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.393253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d266fdc2aa824ff99aadb84a910f1dcd, user_id=b45e0cb7bac5464b937e13868aacc5d3, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.395918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.493653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1008/2015] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:14 2022] PUT /identity/v3/projects/d266fdc2aa824ff99aadb84a910f1dcd/users/b45e0cb7bac5464b937e13868aacc5d3/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:14.497660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.507871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569ee84-b691-4ea4-88f1-ea140bf59fcf admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.562734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964d3d-6b71-43be-b6bf-1d82d5c7a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.563421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964d3d-6b71-43be-b6bf-1d82d5c7a35e admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.563699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964d3d-6b71-43be-b6bf-1d82d5c7a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.563971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964d3d-6b71-43be-b6bf-1d82d5c7a35e admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.564673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89964d3d-6b71-43be-b6bf-1d82d5c7a35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.566261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89964d3d-6b71-43be-b6bf-1d82d5c7a35e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.575604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1008/2016] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:14.579914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.590420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a602cf-4312-4b7d-85ee-282debda2495 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.595141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.596049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.596308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.596576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] PATH_INFO: `/v3/projects/d266fdc2aa824ff99aadb84a910f1dcd/users/b45e0cb7bac5464b937e13868aacc5d3/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.598506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d266fdc2aa824ff99aadb84a910f1dcd, user_id=b45e0cb7bac5464b937e13868aacc5d3, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.601133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.611556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1009/2017] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:14 2022] PUT /identity/v3/projects/d266fdc2aa824ff99aadb84a910f1dcd/users/b45e0cb7bac5464b937e13868aacc5d3/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:14.622431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.622718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.622998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.648585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] MFA Rules not processed for user `b45e0cb7bac5464b937e13868aacc5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:14.649701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:14.716991 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1009/2018] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:14.728175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:14.731304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:14.789423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc888981-ead6-47ac-a905-c79c41224acf admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:14.793286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafe014-ad09-4e7f-a3b0-4a99c1ce2a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:14.793935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafe014-ad09-4e7f-a3b0-4a99c1ce2a2f service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:14.803274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafe014-ad09-4e7f-a3b0-4a99c1ce2a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:14.803274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafe014-ad09-4e7f-a3b0-4a99c1ce2a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:14.851756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafe014-ad09-4e7f-a3b0-4a99c1ce2a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:14.853193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafe014-ad09-4e7f-a3b0-4a99c1ce2a2f service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:14.862623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1010/2019] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:17.390881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:17.401655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02640-11b5-44bc-9591-d9a80077cff6 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:17.406171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:17.406285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:17.406484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:17.406748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:17.409278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:17.469398 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:17.470927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:17.481507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1010/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:18.300094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a402-82b1-4dfc-895f-1f750e27d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:18.300600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a402-82b1-4dfc-895f-1f750e27d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:18.300600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a402-82b1-4dfc-895f-1f750e27d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:18.318521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c471a402-82b1-4dfc-895f-1f750e27d2f0 None None] MFA Rules not processed for user `951fcc6ad18145bd9c9dbe556c1f7270`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:18.321740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c471a402-82b1-4dfc-895f-1f750e27d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:18.394068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1011/2021] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:19.524201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:19.525651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:19.595724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3625-ba6a-4b49-94b4-90bf1c10bd82 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:19.600448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:19.601323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:19.607048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:19.607048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] PATH_INFO: `/v3/users/6474c73bcfe542e2932007e466e2f887` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:19.607048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6474c73bcfe542e2932007e466e2f887)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:19.607048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:19.826488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6474c73bcfe542e2932007e466e2f887'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:19.840361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6474c73bcfe542e2932007e466e2f887'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:19.841138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6474c73bcfe542e2932007e466e2f887'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:19.843182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6474c73bcfe542e2932007e466e2f887'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:19.942243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6474c73bcfe542e2932007e466e2f887'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:19.955657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1011/2022] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:19 2022] DELETE /identity/v3/users/6474c73bcfe542e2932007e466e2f887 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:19.960348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:19.960844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:19.960950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:19.980126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:19.981334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:20.039446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1012/2023] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:20.049368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:20.050771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:20.108142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3bc46-6ae6-4374-9d0e-0946db15d663 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:20.111735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:20.112407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:20.112711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:20.113101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:20.123220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:20.124684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:20.134342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1012/2024] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:20.608759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:20.610421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:20.641343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cefc6-f246-4421-b6d4-0320b215f0d1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:20.646568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:20.647624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:20.647907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:20.648182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] PATH_INFO: `/v3/projects/f244c01e004a4495a871ff3e90d66dda` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:20.649346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f244c01e004a4495a871ff3e90d66dda)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:20.651379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:20.756720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f244c01e004a4495a871ff3e90d66dda', 'request_id': 'req-396f5e28-5dba-421b-8b94-b214c1ef92d0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:20.762182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f244c01e004a4495a871ff3e90d66dda', 'request_id': 'req-396f5e28-5dba-421b-8b94-b214c1ef92d0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:20.768246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f244c01e004a4495a871ff3e90d66dda', 'request_id': 'req-396f5e28-5dba-421b-8b94-b214c1ef92d0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:20.890697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] The token cache is being invalidate because project f244c01e004a4495a871ff3e90d66dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:20.890989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:20.891658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:20.893244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1013/2025] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:20 2022] DELETE /identity/v3/projects/f244c01e004a4495a871ff3e90d66dda => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:20.897165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:20.907408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18d06-4789-4ee9-bf2b-e41a9e91ec4c service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:20.964771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:20.965655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:20.965968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:20.966250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] PATH_INFO: `/v3/users/98c65015b42b45eab9b49999077fc0a8` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:20.967477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c65015b42b45eab9b49999077fc0a8)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:20.969645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:21.210650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c65015b42b45eab9b49999077fc0a8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.224167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c65015b42b45eab9b49999077fc0a8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.224167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c65015b42b45eab9b49999077fc0a8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.224910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c65015b42b45eab9b49999077fc0a8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.311153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4e6b3ff9-8a7e-4761-a882-9b9fd336c7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c65015b42b45eab9b49999077fc0a8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.323629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1013/2026] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:20 2022] DELETE /identity/v3/users/98c65015b42b45eab9b49999077fc0a8 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:21.738642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:21.740626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:21.756280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f5e28-5dba-421b-8b94-b214c1ef92d0 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:21.816261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:21.817128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:21.817412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:21.817693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] PATH_INFO: `/v3/projects/00cd576177e5454dab5c6508536ef4be` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:21.818891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cd576177e5454dab5c6508536ef4be)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:21.820865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:21.959785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cd576177e5454dab5c6508536ef4be', 'request_id': 'req-4bbdb997-6162-43a8-af08-6b3a4812e36e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.965387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cd576177e5454dab5c6508536ef4be', 'request_id': 'req-4bbdb997-6162-43a8-af08-6b3a4812e36e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:21.971841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cd576177e5454dab5c6508536ef4be', 'request_id': 'req-4bbdb997-6162-43a8-af08-6b3a4812e36e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:22.053281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] The token cache is being invalidate because project 00cd576177e5454dab5c6508536ef4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:22.053582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:22.054175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4bbdb997-6162-43a8-af08-6b3a4812e36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:22.055760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1014/2027] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:21 2022] DELETE /identity/v3/projects/00cd576177e5454dab5c6508536ef4be => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:22.061177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.061650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.061736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.080497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:22.081704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:22.141409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1014/2028] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:22.149472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.149738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.150015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.169904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:22.171136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:22.179289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1015/2029] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:22.184343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.195097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466d107-149d-4910-bdd4-ddd2b90f1085 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.201011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.201967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.202258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.202539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.203310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:22.203630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.205313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:22.218999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1015/2030] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:22.223404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.242288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f099f7-af7d-4c8e-a91e-5b9282fe3d06 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.248246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.248934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.249220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.249505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.250216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.252212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:22.352460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1016/2031] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:22 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:22.358044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.369420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7b8ec-9346-4f3f-ac15-d2a571a8c9d8 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.430341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.431010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.431323 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.431602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.432850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.434749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:22.540100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1016/2032] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:22 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:22.545147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.555386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3246-0f12-4e1a-b40c-f26710b30bc9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.561079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.561729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.562013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.562290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.563040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.564684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:22.575444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1017/2033] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:22.579403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.589453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e222-4a48-4af3-806e-8218b0193641 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.594339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba2136-4dd5-468e-bf6d-b2923c972c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.594992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2136-4dd5-468e-bf6d-b2923c972c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.595294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2136-4dd5-468e-bf6d-b2923c972c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.595572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba2136-4dd5-468e-bf6d-b2923c972c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.596282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba2136-4dd5-468e-bf6d-b2923c972c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.597917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba2136-4dd5-468e-bf6d-b2923c972c87 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:22.608464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1017/2034] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:22.612491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.623205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fdbe6-cc2f-4a53-a2b9-bf592b3aa4bf admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.632958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.632958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.632958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.632958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] PATH_INFO: `/v3/projects/86ff401c7d9045dd879aeffc0b219709/users/60fa3703e6b64c23afc7615b276de0e1/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.644511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ff401c7d9045dd879aeffc0b219709, user_id=60fa3703e6b64c23afc7615b276de0e1, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.647137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:22.753651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1018/2035] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:22 2022] PUT /identity/v3/projects/86ff401c7d9045dd879aeffc0b219709/users/60fa3703e6b64c23afc7615b276de0e1/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:22.765479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.765769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.766100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.794573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] MFA Rules not processed for user `60fa3703e6b64c23afc7615b276de0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:22.795818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:22.857448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1018/2036] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:22.862126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:22.921956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac9bdd-d0d2-416d-a40e-835a4957f4ed admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:22.926580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:22.927231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:22.927548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:22.927829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:22.928507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:22.930407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.020610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1019/2037] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:22 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:23.021640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.033269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac20ca7-851c-49a1-90f6-3cd7e77e247e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.087500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.088164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.089094 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.089403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.090095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.092025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.216461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1019/2038] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:23 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:23.220717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.231009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c936f8-ccef-4078-b7ec-fd43d0c81a52 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.235719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.236368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.236648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.236926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.237729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.239341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.250892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1020/2039] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:23.254234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.264927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673df1d-b611-42fe-b9b1-424f8f20da3b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.269721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.270602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.270941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.271164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] PATH_INFO: `/v3/projects/40929697414e4a1ead32554eee5af240/users/d49e36d8628a4101b5ab210a29aafe9d/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.288810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40929697414e4a1ead32554eee5af240, user_id=d49e36d8628a4101b5ab210a29aafe9d, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.291549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.393593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1020/2040] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:23 2022] PUT /identity/v3/projects/40929697414e4a1ead32554eee5af240/users/d49e36d8628a4101b5ab210a29aafe9d/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:23.397474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.407950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93685c-fc6d-4faf-8e63-545338536d6a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.465986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5953003-ba8c-420f-a6a4-3f1e6c107203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.466656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953003-ba8c-420f-a6a4-3f1e6c107203 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.466944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953003-ba8c-420f-a6a4-3f1e6c107203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.467220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953003-ba8c-420f-a6a4-3f1e6c107203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.467973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5953003-ba8c-420f-a6a4-3f1e6c107203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.469816 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5953003-ba8c-420f-a6a4-3f1e6c107203 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.482888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1021/2041] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:23.484215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.494547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaa958-4cf2-4ea7-8ed2-9bc3c0064e8f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.500004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.500894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.501328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.501612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] PATH_INFO: `/v3/projects/40929697414e4a1ead32554eee5af240/users/d49e36d8628a4101b5ab210a29aafe9d/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.504001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40929697414e4a1ead32554eee5af240, user_id=d49e36d8628a4101b5ab210a29aafe9d, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.506767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.518374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1021/2042] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:23 2022] PUT /identity/v3/projects/40929697414e4a1ead32554eee5af240/users/d49e36d8628a4101b5ab210a29aafe9d/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:23.528616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.528918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.529202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.558473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] MFA Rules not processed for user `d49e36d8628a4101b5ab210a29aafe9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:23.559796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:23.627121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1022/2043] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:23.638476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.640302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:23.695820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4f63e-7ba2-4ed5-adec-699f242d2440 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.699463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.703517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.703517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.703517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.709482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.710892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.720943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1022/2044] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:23.819574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:23.820982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:23.833380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6df3fd-2be1-4787-9f8c-f75d8932ecf4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:23.836989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:23.837619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:23.837899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:23.838200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:23.892341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:23.893758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:23.902922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1023/2045] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:27.577782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:27.579462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:27.623440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:27.633568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9395c2-b188-41c2-aac3-771fa107c07c service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:27.637502 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:27.638180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:27.638465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:27.638743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:27.640598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:27.649016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ce0e-7d0d-4f84-8356-3f8247cf5948 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:27.654273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:27.655176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:27.655487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:27.655838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] PATH_INFO: `/v3/users/21b255e9a5614f62b3950a7f4f62b415` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:27.657141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b255e9a5614f62b3950a7f4f62b415)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:27.659071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:27.708695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:27.710150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fda4f-abd8-4d47-bf8c-583813cf608c service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:27.720296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1024/2046] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:27.934908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b255e9a5614f62b3950a7f4f62b415'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:27.957606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b255e9a5614f62b3950a7f4f62b415'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:27.959756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b255e9a5614f62b3950a7f4f62b415'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:27.964251 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b255e9a5614f62b3950a7f4f62b415'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:28.053704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b255e9a5614f62b3950a7f4f62b415'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:28.068273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1023/2047] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:27 2022] DELETE /identity/v3/users/21b255e9a5614f62b3950a7f4f62b415 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:28.072619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:28.073339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:28.074048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:28.100363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:28.102025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:28.167760 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1025/2048] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:28.177244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:28.179623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:28.272940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24e47-f3b9-405d-9a2f-41c4d81bb8cf admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:28.277528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:28.278295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:28.278651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:28.279533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:28.288313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:28.289746 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:28.300184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1024/2049] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:28.849912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:28.851633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:28.865510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11492-c1c0-4ee6-b967-6c76cbe110a4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:28.870930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:28.871856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:28.872139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:28.872598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] PATH_INFO: `/v3/projects/ebb9e162601e48fe878ff2154a927773` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:28.873948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb9e162601e48fe878ff2154a927773)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:28.876010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:29.016684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb9e162601e48fe878ff2154a927773', 'request_id': 'req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.021983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb9e162601e48fe878ff2154a927773', 'request_id': 'req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.028721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb9e162601e48fe878ff2154a927773', 'request_id': 'req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.140617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] The token cache is being invalidate because project ebb9e162601e48fe878ff2154a927773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:29.140893 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.141756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.146114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1026/2050] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:28 2022] DELETE /identity/v3/projects/ebb9e162601e48fe878ff2154a927773 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:29.147532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:29.158461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dadfe-9c2b-48ef-a5f5-d5a8030d6a68 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:29.216380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:29.217261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:29.217570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:29.217814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] PATH_INFO: `/v3/users/49a9c2dcea6f44ada511174fd397c62c` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:29.219468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a9c2dcea6f44ada511174fd397c62c)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:29.221432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:29.418967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a9c2dcea6f44ada511174fd397c62c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.420693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:29.422193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:29.433383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a9c2dcea6f44ada511174fd397c62c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.434169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a9c2dcea6f44ada511174fd397c62c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.434848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a9c2dcea6f44ada511174fd397c62c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.440866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbb7a5-e35e-4e95-878c-33c071cf48d5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:29.445522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:29.446448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:29.446732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:29.447003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] PATH_INFO: `/v3/users/60fa3703e6b64c23afc7615b276de0e1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:29.450746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fa3703e6b64c23afc7615b276de0e1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:29.453092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:29.511809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1b3b4adc-c43c-4fad-9844-72ee8b708db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a9c2dcea6f44ada511174fd397c62c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.525732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1025/2051] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:29 2022] DELETE /identity/v3/users/49a9c2dcea6f44ada511174fd397c62c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:29.627620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fa3703e6b64c23afc7615b276de0e1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.638191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fa3703e6b64c23afc7615b276de0e1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.638908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fa3703e6b64c23afc7615b276de0e1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.639529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fa3703e6b64c23afc7615b276de0e1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.656233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fa3703e6b64c23afc7615b276de0e1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:29.778900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1027/2052] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:29 2022] DELETE /identity/v3/users/60fa3703e6b64c23afc7615b276de0e1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:29.782406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:29.782692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:29.782970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:29.807803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:29.809364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:29.876938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1026/2053] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:29.886829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:29.888487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:29.949819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d86e8-1e17-42a7-93d7-a7f992c7c409 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:29.953604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:29.954255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:29.954541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:29.954819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:29.964729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:29.966227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:29.977004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1028/2054] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:30.106156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:30.108425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:30.141074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db60fad-2a8f-469d-afb3-84e6c587e288 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:30.147825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:30.148700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:30.148979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:30.150154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] PATH_INFO: `/v3/projects/2a1332a1422949e09706d52466623cad` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:30.152056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1332a1422949e09706d52466623cad)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:30.154177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:30.316088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1332a1422949e09706d52466623cad', 'request_id': 'req-4b7159b4-7594-40fe-a2e9-add40ab37649'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.398423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1332a1422949e09706d52466623cad', 'request_id': 'req-4b7159b4-7594-40fe-a2e9-add40ab37649'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.405213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1332a1422949e09706d52466623cad', 'request_id': 'req-4b7159b4-7594-40fe-a2e9-add40ab37649'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.418283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] The token cache is being invalidate because project 2a1332a1422949e09706d52466623cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:30.418808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.419530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.421121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1027/2055] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:30 2022] DELETE /identity/v3/projects/2a1332a1422949e09706d52466623cad => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:30.425715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:30.436385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded81bf5-61b2-46ed-b9bd-9c7eaad520ec service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:30.493902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:30.494809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:30.495096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:30.495412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] PATH_INFO: `/v3/users/e3a559f744554520aa9fd153cd6e5c0d` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:30.496615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a559f744554520aa9fd153cd6e5c0d)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:30.498618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:30.505027 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:30.506802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:30.526859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7159b4-7594-40fe-a2e9-add40ab37649 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:30.533219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:30.534213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:30.535121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:30.535529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] PATH_INFO: `/v3/projects/86ff401c7d9045dd879aeffc0b219709` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:30.536921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ff401c7d9045dd879aeffc0b219709)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:30.540659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:30.715016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a559f744554520aa9fd153cd6e5c0d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.719688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ff401c7d9045dd879aeffc0b219709', 'request_id': 'req-11030894-64fc-4d4f-b287-a66b8592fb3b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.722336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a559f744554520aa9fd153cd6e5c0d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.723030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a559f744554520aa9fd153cd6e5c0d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.723652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a559f744554520aa9fd153cd6e5c0d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.740701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a559f744554520aa9fd153cd6e5c0d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.904606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ff401c7d9045dd879aeffc0b219709', 'request_id': 'req-11030894-64fc-4d4f-b287-a66b8592fb3b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.910769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ff401c7d9045dd879aeffc0b219709', 'request_id': 'req-11030894-64fc-4d4f-b287-a66b8592fb3b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.922467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] The token cache is being invalidate because project 86ff401c7d9045dd879aeffc0b219709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:30.922631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.923297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:30.924894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1028/2056] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:30 2022] DELETE /identity/v3/projects/86ff401c7d9045dd879aeffc0b219709 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:30.928756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:30.930152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:30.994912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11030894-64fc-4d4f-b287-a66b8592fb3b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:30.999743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:31.000632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:31.000909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:31.001179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] PATH_INFO: `/v3/users/d49e36d8628a4101b5ab210a29aafe9d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:31.002539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49e36d8628a4101b5ab210a29aafe9d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:31.004677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:31.038889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1029/2057] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:30 2022] DELETE /identity/v3/users/e3a559f744554520aa9fd153cd6e5c0d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:31.195666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49e36d8628a4101b5ab210a29aafe9d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.207660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49e36d8628a4101b5ab210a29aafe9d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.208362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49e36d8628a4101b5ab210a29aafe9d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.208981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49e36d8628a4101b5ab210a29aafe9d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.273044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49e36d8628a4101b5ab210a29aafe9d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.287163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1029/2058] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:30 2022] DELETE /identity/v3/users/d49e36d8628a4101b5ab210a29aafe9d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:31.496465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:31.497918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:31.573356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31e52f-3583-4a19-872f-561f5a0f1200 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:31.634856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:31.636328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:31.636625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:31.636899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] PATH_INFO: `/v3/projects/febd80d668bd4dfe9de3ff18a59221dc` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:31.638114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] RBAC: Authorizing `identity:delete_project(project_id=febd80d668bd4dfe9de3ff18a59221dc)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:31.640173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:31.759406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febd80d668bd4dfe9de3ff18a59221dc', 'request_id': 'req-f55519bf-66ab-474d-afce-3a14cdf3913a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.766191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febd80d668bd4dfe9de3ff18a59221dc', 'request_id': 'req-f55519bf-66ab-474d-afce-3a14cdf3913a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.772640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febd80d668bd4dfe9de3ff18a59221dc', 'request_id': 'req-f55519bf-66ab-474d-afce-3a14cdf3913a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.834996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:31.836510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:31.852134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801343e-83d5-46ed-b19c-7e3d9783f579 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:31.876743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] The token cache is being invalidate because project febd80d668bd4dfe9de3ff18a59221dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:31.877089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.877929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f55519bf-66ab-474d-afce-3a14cdf3913a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:31.879976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1030/2059] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:31 2022] DELETE /identity/v3/projects/febd80d668bd4dfe9de3ff18a59221dc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:31.887238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213172c-a83c-4139-873b-ac30dc171976 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:31.887803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213172c-a83c-4139-873b-ac30dc171976 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:31.888250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213172c-a83c-4139-873b-ac30dc171976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:31.913385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e213172c-a83c-4139-873b-ac30dc171976 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:31.914713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:31.915184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e213172c-a83c-4139-873b-ac30dc171976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:31.915610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:31.915893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:31.916200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] PATH_INFO: `/v3/projects/40929697414e4a1ead32554eee5af240` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:31.918098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40929697414e4a1ead32554eee5af240)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:31.920086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:31.924851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1031/2060] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:31.933693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:31.933979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:31.934256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:31.954012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:31.955195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:31.963158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1032/2061] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:31.968993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:31.977720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95215a-a048-474f-8f11-415f54081d0f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:31.982881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:31.983576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:31.983858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:31.984132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:31.984837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:31.985139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:31.986714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:31.998496 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1033/2062] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:29:32.002456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.011668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6682-67d2-4430-9987-0936f4d03171 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.016228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.016826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.017107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.017381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.018036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.019940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.038329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40929697414e4a1ead32554eee5af240', 'request_id': 'req-05d4d0e3-9720-4527-9201-273182e9421a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:32.142674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1034/2063] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:32.146811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40929697414e4a1ead32554eee5af240', 'request_id': 'req-05d4d0e3-9720-4527-9201-273182e9421a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:32.146948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.153144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40929697414e4a1ead32554eee5af240', 'request_id': 'req-05d4d0e3-9720-4527-9201-273182e9421a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:32.164350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] The token cache is being invalidate because project 40929697414e4a1ead32554eee5af240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:32.164632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:32.165268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-05d4d0e3-9720-4527-9201-273182e9421a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:32.167792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1030/2064] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:31 2022] DELETE /identity/v3/projects/40929697414e4a1ead32554eee5af240 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:32.172668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e3c9-eeca-40c2-94f3-834d3d5efade None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.172951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e3c9-eeca-40c2-94f3-834d3d5efade None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.173227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e3c9-eeca-40c2-94f3-834d3d5efade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.192741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-aea5e3c9-eeca-40c2-94f3-834d3d5efade None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:32.194012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-aea5e3c9-eeca-40c2-94f3-834d3d5efade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:32.210772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55f60-968d-4fc7-8b56-f5c02089bfb3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.216712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.218283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.218568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.218843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.220628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.221619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.266591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1031/2065] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:32.274314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45c86-566a-4608-b248-1488ef615654 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.274605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45c86-566a-4608-b248-1488ef615654 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.274884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45c86-566a-4608-b248-1488ef615654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.294265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-30c45c86-566a-4608-b248-1488ef615654 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:32.295501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-30c45c86-566a-4608-b248-1488ef615654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:32.304260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1032/2066] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:32.308557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45c86-566a-4608-b248-1488ef615654 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.314359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1035/2067] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:32.317871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.318983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45c86-566a-4608-b248-1488ef615654 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.319507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:32.324612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.325182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.325565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.325945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.326981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:32.327427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.329201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.336102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde9446-da16-46eb-8799-21315267bbc6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.343153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1033/2068] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:29:32.347390 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.350663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.351522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.351906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.352286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.353118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.355709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.357859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0a3fb-f832-4753-b04f-5d687fab8132 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.362581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.363220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.363530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.363804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.364479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.369391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1036/2069] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:32.369517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.370988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.381672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b7ec3-6991-4efe-bfc5-66d3f5919c5f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.386908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.387637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.387925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.388231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.389083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.390698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.401953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1037/2070] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:32.411614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.421972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb67b-bbe7-4989-9a6d-c62004d43288 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.426505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663459c-e5d7-4ae6-9e66-ca8b27ffc140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.427405 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663459c-e5d7-4ae6-9e66-ca8b27ffc140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.427735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663459c-e5d7-4ae6-9e66-ca8b27ffc140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.428018 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663459c-e5d7-4ae6-9e66-ca8b27ffc140 admin admin] PATH_INFO: `/v3/projects/54a05857b8ea40f3b53a97ba2d2d3130/users/4e30fb0df7cc4c9fa729371617c458d8/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.442132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663459c-e5d7-4ae6-9e66-ca8b27ffc140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a05857b8ea40f3b53a97ba2d2d3130, user_id=4e30fb0df7cc4c9fa729371617c458d8, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.444860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663459c-e5d7-4ae6-9e66-ca8b27ffc140 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.505945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1034/2071] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:32.510649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.533604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1038/2072] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:32 2022] PUT /identity/v3/projects/54a05857b8ea40f3b53a97ba2d2d3130/users/4e30fb0df7cc4c9fa729371617c458d8/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:32.548750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.549099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.549433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.572895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2435e1-94d8-487f-99ff-147dd9b8b3df admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.575177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] MFA Rules not processed for user `4e30fb0df7cc4c9fa729371617c458d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:32.576428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:32.630623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.631321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.631609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.631886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.632591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.634533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.640472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1039/2073] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:32.644749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.658309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e075a-9efb-4ce2-85f2-e9e834ef3f30 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.667548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.668202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.668489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.668766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.669460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.671413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.719060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1035/2074] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:32.720889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.731098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f8342-7313-4677-a8ea-c5561cb20b58 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.735765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.736422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.736691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.736990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.737775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.739387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.749366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1036/2075] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:32.753180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.763179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8408b-b7af-4127-be93-97eb3337a6a1 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.767838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.768457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.768734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.771743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.771743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.771743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.776174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1040/2076] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:32.780074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.782736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1037/2077] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:32.786624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.796440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951156-87bf-4b70-9687-09182161fb74 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.852487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb3b58-f139-41fa-9814-b127f276b6e3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.857118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32516c-71eb-4c96-b04b-3f43ded6f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.858023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32516c-71eb-4c96-b04b-3f43ded6f6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.858306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32516c-71eb-4c96-b04b-3f43ded6f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.858715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32516c-71eb-4c96-b04b-3f43ded6f6bc admin admin] PATH_INFO: `/v3/projects/d372fbe106344b5d9b987ae25bf544b4/users/aa9f89b740394bd095ad22284ddbd02a/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.858815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.859580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.859813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.860094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.860786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.863088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.874504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32516c-71eb-4c96-b04b-3f43ded6f6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d372fbe106344b5d9b987ae25bf544b4, user_id=aa9f89b740394bd095ad22284ddbd02a, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.877470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32516c-71eb-4c96-b04b-3f43ded6f6bc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.954383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1041/2078] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:32.958486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:32.969233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d95cc-c056-40fa-9b8a-4f83df3b8c7e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:32.974044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:32.974710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.974994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.975331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.976060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:32.977772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:32.979104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1038/2079] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:32 2022] PUT /identity/v3/projects/d372fbe106344b5d9b987ae25bf544b4/users/aa9f89b740394bd095ad22284ddbd02a/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:32.992096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1042/2080] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:32.992274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:32.992274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:32.992274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:32.993124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.004260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f581-cfba-41ec-8d1c-faa8abe525e7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.022245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] MFA Rules not processed for user `aa9f89b740394bd095ad22284ddbd02a`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:33.023502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:33.069262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.069931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.070214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.070487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.071209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.073390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.086667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1043/2081] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:33.088639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.096561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1039/2082] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:33.100996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.103329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e767fd5-2b70-4e14-935c-41ced05222f5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.110973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e89b-0f7d-4a17-b8ba-813e98a44dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.111989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e89b-0f7d-4a17-b8ba-813e98a44dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.112350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e89b-0f7d-4a17-b8ba-813e98a44dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.112499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e08a-94c6-4ab8-ab30-1c5e98431b35 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.112752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e89b-0f7d-4a17-b8ba-813e98a44dd0 admin admin] PATH_INFO: `/v3/projects/910295d43af042849eb8950a3e16d38d/users/ada3c5b51a8945f5b05b3c9cdb7b5709/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.116987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.117629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.117908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.118184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.118857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.121445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.128372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e89b-0f7d-4a17-b8ba-813e98a44dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910295d43af042849eb8950a3e16d38d, user_id=ada3c5b51a8945f5b05b3c9cdb7b5709, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.131078 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e89b-0f7d-4a17-b8ba-813e98a44dd0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.209325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1044/2083] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:33 2022] PUT /identity/v3/projects/910295d43af042849eb8950a3e16d38d/users/ada3c5b51a8945f5b05b3c9cdb7b5709/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:33.219891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.220182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.224109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.224227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1040/2084] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:33.226976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.249349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] MFA Rules not processed for user `ada3c5b51a8945f5b05b3c9cdb7b5709`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:33.250568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:33.295467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433871-abe4-4eb5-8bfa-fb6ecdba53c6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.300378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.301113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.301467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.301826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.302515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.304536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.319978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1045/2085] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:33.325163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.335129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30173a1-7962-49f4-a49f-40a27e57675e None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.340166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.340722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.341010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.341292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.341977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.344428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.393134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1041/2086] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:33.397079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.407015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef22b6-9ab5-489a-8fbb-b4b257aa545d admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.412384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.413050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.413337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.413614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.414408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.416197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.430039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1042/2087] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:33.432317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.449621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7b578-f410-47ed-b490-e70f6740fae7 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.453305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1046/2088] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:33.457103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.458087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.459003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.459315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.459625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] PATH_INFO: `/v3/projects/7a9783c5ef92414aad90cd702acea16c/users/b04be3cc3dc34a2f95d7ef128904f6d1/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.485885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9783c5ef92414aad90cd702acea16c, user_id=b04be3cc3dc34a2f95d7ef128904f6d1, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.489031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.524948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8978a-1dd6-4111-bca5-990d4cd65c50 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.529997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.530660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.530940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.531212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.531990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.533946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.575890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1043/2089] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:33 2022] PUT /identity/v3/projects/7a9783c5ef92414aad90cd702acea16c/users/b04be3cc3dc34a2f95d7ef128904f6d1/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:33.579749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.639970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7f4a2-6db2-4a0c-b846-d3a81c9af0a7 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.643448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1047/2090] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:33.644625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.644861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.645526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.645813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.646092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.646813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.648448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.654391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf55c5-a262-4d43-be3d-bec3c9e25add admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.662220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1044/2091] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:33.662377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.662377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.662377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.662377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.662730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.663286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.663892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.674031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1048/2092] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:33.674512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421300d-08dd-417c-bd2d-af90f85cec8a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.677966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.679758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4f857-4c85-4cd8-923d-63a4939711f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.682871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f857-4c85-4cd8-923d-63a4939711f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.682871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f857-4c85-4cd8-923d-63a4939711f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.682871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f857-4c85-4cd8-923d-63a4939711f9 admin admin] PATH_INFO: `/v3/projects/7a9783c5ef92414aad90cd702acea16c/users/b04be3cc3dc34a2f95d7ef128904f6d1/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.683891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4f857-4c85-4cd8-923d-63a4939711f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9783c5ef92414aad90cd702acea16c, user_id=b04be3cc3dc34a2f95d7ef128904f6d1, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.686535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4f857-4c85-4cd8-923d-63a4939711f9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.688076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2aa075-de10-4e40-a99d-307edfddeaca admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.692815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.693711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.694075 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.694337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] PATH_INFO: `/v3/projects/aedcfc9195e84540be2a37612083ed2b/users/6459c626904241b7b06739d2cc251e78/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.696782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1045/2093] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:33 2022] PUT /identity/v3/projects/7a9783c5ef92414aad90cd702acea16c/users/b04be3cc3dc34a2f95d7ef128904f6d1/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:33.707516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.710871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.710871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.711050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedcfc9195e84540be2a37612083ed2b, user_id=6459c626904241b7b06739d2cc251e78, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.712713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.735077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] MFA Rules not processed for user `b04be3cc3dc34a2f95d7ef128904f6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:33.736462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:33.802780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1046/2094] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:33.814384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.815762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:33.821371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1049/2095] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:33 2022] PUT /identity/v3/projects/aedcfc9195e84540be2a37612083ed2b/users/6459c626904241b7b06739d2cc251e78/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:33.825106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.874900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c487b6-2f61-4af2-93b5-fcd114d1df95 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.885775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc794d-d8ed-41cf-a30e-f1a9402a0680 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.890404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.891063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.891371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.891648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.892401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.893992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.904390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1050/2096] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:33.908434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:33.918312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c8e-2cfa-436c-824c-7025df71665e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:33.923128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.923325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2b9b-df6e-417e-9d53-76111c0b699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:33.923795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.924019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2b9b-df6e-417e-9d53-76111c0b699b admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.924121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.924302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2b9b-df6e-417e-9d53-76111c0b699b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.924410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.924577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2b9b-df6e-417e-9d53-76111c0b699b admin admin] PATH_INFO: `/v3/projects/aedcfc9195e84540be2a37612083ed2b/users/6459c626904241b7b06739d2cc251e78/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.926498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca2b9b-df6e-417e-9d53-76111c0b699b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedcfc9195e84540be2a37612083ed2b, user_id=6459c626904241b7b06739d2cc251e78, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.929134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca2b9b-df6e-417e-9d53-76111c0b699b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:33.939919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1051/2097] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:33 2022] PUT /identity/v3/projects/aedcfc9195e84540be2a37612083ed2b/users/6459c626904241b7b06739d2cc251e78/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:33.951015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:33.951327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:33.951612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:33.981076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] MFA Rules not processed for user `6459c626904241b7b06739d2cc251e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:33.982384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:33.991704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:33.993195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:34.003058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1047/2098] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:34.055537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1052/2099] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:34.067282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:34.068651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:34.079318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddd26b-715a-4545-89c2-2d67e8a2dda9 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:34.142987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:34.143672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:34.143954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:34.144227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:34.154786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:34.156356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:34.167459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1048/2100] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:34.264046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:34.274295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b09a2-3fa4-4626-933d-bae9795c421c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:34.279715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:34.280678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:34.281107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:34.281574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:34.324443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:34.334029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c6ae-3b5c-42a0-bb94-02beda937f23 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:34.338899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae416de-db76-41e6-bd81-af5e21374ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:34.339921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae416de-db76-41e6-bd81-af5e21374ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:34.340365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae416de-db76-41e6-bd81-af5e21374ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:34.340856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae416de-db76-41e6-bd81-af5e21374ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:34.351829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:34.353314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:34.363556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1053/2101] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:34.418812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae416de-db76-41e6-bd81-af5e21374ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:34.420384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae416de-db76-41e6-bd81-af5e21374ca7 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:34.429813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1049/2102] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:39.314115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:39.318240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:39.384327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa50d2-fc4a-4069-bb55-3be75dd15645 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:39.388932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:39.389808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:39.390087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:39.390360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] PATH_INFO: `/v3/users/efe249ce990a466e98f2017db24d4b58` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:39.391569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe249ce990a466e98f2017db24d4b58)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:39.393521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:39.666913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe249ce990a466e98f2017db24d4b58'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:39.676152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe249ce990a466e98f2017db24d4b58'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:39.676954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe249ce990a466e98f2017db24d4b58'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:39.677565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe249ce990a466e98f2017db24d4b58'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:39.689434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe249ce990a466e98f2017db24d4b58'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:39.804068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1054/2103] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:39 2022] DELETE /identity/v3/users/efe249ce990a466e98f2017db24d4b58 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:39.810620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:39.810620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:39.810620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:39.826780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:39.828013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:39.887359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1050/2104] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:39.897149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:39.898567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:39.920709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:39.922141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:39.934661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64889db7-d93e-4205-9511-2f939cc0ab41 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:39.939171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:39.940142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:39.940421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:39.940694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] PATH_INFO: `/v3/users/4e30fb0df7cc4c9fa729371617c458d8` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:39.941884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e30fb0df7cc4c9fa729371617c458d8)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:39.943857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:39.960156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4c03-54b3-4a57-a878-75778061b3ff admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:39.964240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:39.964894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:39.965186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:39.965486 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:39.975503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:39.977423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:39.987173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1055/2105] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:40.115113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e30fb0df7cc4c9fa729371617c458d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.122398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:40.123794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.127957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e30fb0df7cc4c9fa729371617c458d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.128860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e30fb0df7cc4c9fa729371617c458d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.129739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e30fb0df7cc4c9fa729371617c458d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.141618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd50a0-d79a-489c-acb6-517e29f4e6e9 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:40.148530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:40.149989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:40.150336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:40.150673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] PATH_INFO: `/v3/users/525a4beedd2f4468b91928d8cbd3a8ab` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:40.158710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=525a4beedd2f4468b91928d8cbd3a8ab)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:40.164935 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:40.218897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-083e0673-1d43-4956-94e9-491c58dbbbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e30fb0df7cc4c9fa729371617c458d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.235907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1051/2106] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:39 2022] DELETE /identity/v3/users/4e30fb0df7cc4c9fa729371617c458d8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:40.241374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:40.241903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:40.242260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:40.263780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:40.265010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.351859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1052/2107] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:40.352806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525a4beedd2f4468b91928d8cbd3a8ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.362018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:40.363969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.382365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525a4beedd2f4468b91928d8cbd3a8ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.383766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525a4beedd2f4468b91928d8cbd3a8ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.384660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525a4beedd2f4468b91928d8cbd3a8ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.401603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1a595fdf-0317-4644-9ebb-c62989723d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525a4beedd2f4468b91928d8cbd3a8ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:40.454597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218bc0f-e22e-416b-a82f-35c8825e1f3d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:40.460054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:40.461166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:40.461905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:40.462400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:40.468033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.487040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1056/2108] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:40 2022] DELETE /identity/v3/users/525a4beedd2f4468b91928d8cbd3a8ab => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:40.492419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:40.492816 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:40.492971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:40.496173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:40.497971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:40.517476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1053/2109] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:40.543210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:40.546814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.593955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:40.595500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.627020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf796ee-2e6f-4e9c-b6db-5cdd104c1e05 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:40.663882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1057/2110] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:40.684384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:40.685913 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:40.758605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab099144-1080-4e6b-9a14-eb2aeea92b37 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:40.764553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:40.765010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:40.765728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:40.765900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:40.766010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:40.766140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:40.766296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:40.766410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] PATH_INFO: `/v3/projects/07dc5c064d4c4ce292625751b0eb39ca` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:40.767771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07dc5c064d4c4ce292625751b0eb39ca)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:40.769876 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:40.780589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:40.782051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:40.793512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1058/2111] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:40.960821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07dc5c064d4c4ce292625751b0eb39ca', 'request_id': 'req-f3a53161-ac8c-4246-8441-06ff00970fb7'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.055549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07dc5c064d4c4ce292625751b0eb39ca', 'request_id': 'req-f3a53161-ac8c-4246-8441-06ff00970fb7'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.062726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07dc5c064d4c4ce292625751b0eb39ca', 'request_id': 'req-f3a53161-ac8c-4246-8441-06ff00970fb7'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.074181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] The token cache is being invalidate because project 07dc5c064d4c4ce292625751b0eb39ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:41.074586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.075470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.077237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1054/2112] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:40 2022] DELETE /identity/v3/projects/07dc5c064d4c4ce292625751b0eb39ca => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:41.081561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:41.093087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797985ca-323f-4385-8a60-6697df202651 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:41.094518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:41.096018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:41.184364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53161-ac8c-4246-8441-06ff00970fb7 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:41.189147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:41.190011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:41.190290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:41.190864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] PATH_INFO: `/v3/projects/54a05857b8ea40f3b53a97ba2d2d3130` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:41.191236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:41.191778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a05857b8ea40f3b53a97ba2d2d3130)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:41.192873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:41.193363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:41.193698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:41.193866 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] PATH_INFO: `/v3/users/b45e0cb7bac5464b937e13868aacc5d3` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:41.196306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45e0cb7bac5464b937e13868aacc5d3)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:41.198775 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:41.487965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45e0cb7bac5464b937e13868aacc5d3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.488993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a05857b8ea40f3b53a97ba2d2d3130', 'request_id': 'req-3594d20b-999b-497f-a819-16833dc9fbc5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.504805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45e0cb7bac5464b937e13868aacc5d3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.508356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45e0cb7bac5464b937e13868aacc5d3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.508356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45e0cb7bac5464b937e13868aacc5d3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.536049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45e0cb7bac5464b937e13868aacc5d3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.569939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a05857b8ea40f3b53a97ba2d2d3130', 'request_id': 'req-3594d20b-999b-497f-a819-16833dc9fbc5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.578605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a05857b8ea40f3b53a97ba2d2d3130', 'request_id': 'req-3594d20b-999b-497f-a819-16833dc9fbc5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.594097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] The token cache is being invalidate because project 54a05857b8ea40f3b53a97ba2d2d3130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:41.594296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.594959 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.596521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1055/2113] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:41 2022] DELETE /identity/v3/projects/54a05857b8ea40f3b53a97ba2d2d3130 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:41.597595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:41.600364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:41.662087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1059/2114] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:41 2022] DELETE /identity/v3/users/b45e0cb7bac5464b937e13868aacc5d3 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:41.663174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:41.664807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:41.674017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594d20b-999b-497f-a819-16833dc9fbc5 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:41.755366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55bc0f-48c8-4a01-b5d4-8ba84f0b06f5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:41.764236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:41.765177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:41.765500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:41.765783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] PATH_INFO: `/v3/projects/c03ef1aa7b144f80bf196937945716a1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:41.767205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03ef1aa7b144f80bf196937945716a1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:41.768020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:41.769125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:41.769240 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:41.779594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:41.779594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] PATH_INFO: `/v3/users/ada3c5b51a8945f5b05b3c9cdb7b5709` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:41.779594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada3c5b51a8945f5b05b3c9cdb7b5709)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:41.779594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:41.890972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03ef1aa7b144f80bf196937945716a1', 'request_id': 'req-590b08e6-eb4f-43b3-b8be-0df1764204ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.972731 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03ef1aa7b144f80bf196937945716a1', 'request_id': 'req-590b08e6-eb4f-43b3-b8be-0df1764204ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.979952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03ef1aa7b144f80bf196937945716a1', 'request_id': 'req-590b08e6-eb4f-43b3-b8be-0df1764204ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.990802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada3c5b51a8945f5b05b3c9cdb7b5709'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.994950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] The token cache is being invalidate because project c03ef1aa7b144f80bf196937945716a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:41.995335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.996061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:41.998213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1056/2115] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:41 2022] DELETE /identity/v3/projects/c03ef1aa7b144f80bf196937945716a1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:42.001863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada3c5b51a8945f5b05b3c9cdb7b5709'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.002572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada3c5b51a8945f5b05b3c9cdb7b5709'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.003169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:42.003344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada3c5b51a8945f5b05b3c9cdb7b5709'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.005165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:42.016250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada3c5b51a8945f5b05b3c9cdb7b5709'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.091877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1060/2116] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:41 2022] DELETE /identity/v3/users/ada3c5b51a8945f5b05b3c9cdb7b5709 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:42.097483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b08e6-eb4f-43b3-b8be-0df1764204ce admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:42.139758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:42.141442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:42.161847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:42.162721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:42.162999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:42.163298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] PATH_INFO: `/v3/users/8c81acb025174d2b8a5dce0b0449c748` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:42.164497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c81acb025174d2b8a5dce0b0449c748)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:42.167130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:42.209694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05599b8-782d-43fb-8278-995769e49bb9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:42.215066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:42.215981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:42.216390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:42.216750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] PATH_INFO: `/v3/users/aa9f89b740394bd095ad22284ddbd02a` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:42.218953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9f89b740394bd095ad22284ddbd02a)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:42.221036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:42.377723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c81acb025174d2b8a5dce0b0449c748'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.391143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c81acb025174d2b8a5dce0b0449c748'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.391836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c81acb025174d2b8a5dce0b0449c748'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.392969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c81acb025174d2b8a5dce0b0449c748'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.421779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9f89b740394bd095ad22284ddbd02a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.428699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9f89b740394bd095ad22284ddbd02a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.429373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9f89b740394bd095ad22284ddbd02a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.429986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9f89b740394bd095ad22284ddbd02a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.443120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-78ea497d-a7da-4ac0-817f-70c695b5598f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9f89b740394bd095ad22284ddbd02a'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.461891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c81acb025174d2b8a5dce0b0449c748'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.475819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1057/2117] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:42 2022] DELETE /identity/v3/users/8c81acb025174d2b8a5dce0b0449c748 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:42.476980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:42.481024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:42.552632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f5b5-3673-44dd-b554-3cb446c88f5b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:42.553777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1061/2118] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:42 2022] DELETE /identity/v3/users/aa9f89b740394bd095ad22284ddbd02a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:42.559154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:42.559546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:42.559824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:42.578779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:42.580028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:42.647606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:42.647967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1062/2119] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:42.648916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:42.649460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:42.649744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] PATH_INFO: `/v3/projects/d266fdc2aa824ff99aadb84a910f1dcd` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:42.656643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d266fdc2aa824ff99aadb84a910f1dcd)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:42.659985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:42.662149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:42.663412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:42.740695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27389e06-cb22-4cf7-bc2c-857a333c5f35 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:42.745053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:42.745953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:42.746171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:42.746363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:42.755896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:42.757436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:42.769993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1063/2120] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:42.812365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:42.815975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:42.830090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd266fdc2aa824ff99aadb84a910f1dcd', 'request_id': 'req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.842719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3247-b53e-4ba0-919f-d747db5551d8 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:42.939542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:42.940823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:42.941238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:42.941404 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] PATH_INFO: `/v3/projects/910295d43af042849eb8950a3e16d38d` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:42.942932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910295d43af042849eb8950a3e16d38d)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:42.947806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:42.969211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd266fdc2aa824ff99aadb84a910f1dcd', 'request_id': 'req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:42.977759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd266fdc2aa824ff99aadb84a910f1dcd', 'request_id': 'req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.015867 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] The token cache is being invalidate because project d266fdc2aa824ff99aadb84a910f1dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:43.016238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.017418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4cebddd2-a8f1-4177-a9f6-3e1d077dacfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.019430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1058/2121] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:42 2022] DELETE /identity/v3/projects/d266fdc2aa824ff99aadb84a910f1dcd => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:43.026495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b0de6-e23e-46c8-972d-21d1f1c6fa1b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.026781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b0de6-e23e-46c8-972d-21d1f1c6fa1b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.027049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b0de6-e23e-46c8-972d-21d1f1c6fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.066146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-178b0de6-e23e-46c8-972d-21d1f1c6fa1b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:43.068084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-178b0de6-e23e-46c8-972d-21d1f1c6fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.088480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1059/2122] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:43.100474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910295d43af042849eb8950a3e16d38d', 'request_id': 'req-c2bf0803-33ac-424d-bccd-910cbcf50e23'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.102450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.102984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.103559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.124643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910295d43af042849eb8950a3e16d38d', 'request_id': 'req-c2bf0803-33ac-424d-bccd-910cbcf50e23'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.141510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910295d43af042849eb8950a3e16d38d', 'request_id': 'req-c2bf0803-33ac-424d-bccd-910cbcf50e23'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.143288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:43.144567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.226296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1060/2123] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:43.226449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] The token cache is being invalidate because project 910295d43af042849eb8950a3e16d38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:43.226710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.227510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.232415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1064/2124] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:42 2022] DELETE /identity/v3/projects/910295d43af042849eb8950a3e16d38d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:43.232574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.233598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.235020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.242636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2570-9020-4c97-ba94-6be3c5e2cce4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.250326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.255451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.255451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.255451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.255451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:43.255451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.255451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.258352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf0803-33ac-424d-bccd-910cbcf50e23 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.264343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.265329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.265577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.265839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] PATH_INFO: `/v3/users/6459c626904241b7b06739d2cc251e78` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.267044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6459c626904241b7b06739d2cc251e78)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.271435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1061/2125] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:43.271611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.272344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.274538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.289516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd442e-fa40-4ef0-b1f0-7109a73c534e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.294369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.295031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.295340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.295623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.296312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.298250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.437544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1062/2126] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:43 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:43.437544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.437544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.508788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eaa98-eb05-4c4a-94af-1cb504b397d5 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.514984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.515541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.516758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.516758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] PATH_INFO: `/v3/projects/8d87950c443a4090a4097b51dce728c4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.517401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d87950c443a4090a4097b51dce728c4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.519337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.551525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6459c626904241b7b06739d2cc251e78'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.558126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6459c626904241b7b06739d2cc251e78'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.558784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6459c626904241b7b06739d2cc251e78'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.559408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6459c626904241b7b06739d2cc251e78'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.570728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6459c626904241b7b06739d2cc251e78'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.636176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d87950c443a4090a4097b51dce728c4', 'request_id': 'req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.652728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1065/2127] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:43 2022] DELETE /identity/v3/users/6459c626904241b7b06739d2cc251e78 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:43.656719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.656719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.722027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5864c-1159-435c-8499-52c93e3164cc admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.726731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43739420-6cf6-43fc-a232-79b7807bf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.727642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739420-6cf6-43fc-a232-79b7807bf6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.727915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739420-6cf6-43fc-a232-79b7807bf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.728350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43739420-6cf6-43fc-a232-79b7807bf6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.729327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43739420-6cf6-43fc-a232-79b7807bf6e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.731304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43739420-6cf6-43fc-a232-79b7807bf6e7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.735146 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d87950c443a4090a4097b51dce728c4', 'request_id': 'req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.741611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d87950c443a4090a4097b51dce728c4', 'request_id': 'req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.753495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] The token cache is being invalidate because project 8d87950c443a4090a4097b51dce728c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:43.753828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.754453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:43.756031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1063/2128] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:43 2022] DELETE /identity/v3/projects/8d87950c443a4090a4097b51dce728c4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:43.756872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.758114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.820565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583ff5e-7f85-43f9-8ca3-7fb4f6b4ece5 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.825920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.826777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.827056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.827361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] PATH_INFO: `/v3/projects/d372fbe106344b5d9b987ae25bf544b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.828533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d372fbe106344b5d9b987ae25bf544b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.830422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.832375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1066/2129] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:43 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:43.833662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.833948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.834260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.852803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:43.854648 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.870109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1067/2130] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:43.870109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.871639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.883979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c058b1-52b1-4e28-b674-bce919a3cf93 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.889967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523ebda-a94c-42a3-938c-531b6e6ac3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.890727 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ebda-a94c-42a3-938c-531b6e6ac3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.891268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ebda-a94c-42a3-938c-531b6e6ac3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.892993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ebda-a94c-42a3-938c-531b6e6ac3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.892993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523ebda-a94c-42a3-938c-531b6e6ac3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.894239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523ebda-a94c-42a3-938c-531b6e6ac3dd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.906766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1068/2131] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:43.909157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.909157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.909157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.927918 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:43.929206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:43.937831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1069/2132] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:43.938637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.949060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65396b1-7834-43e1-bb9b-566536a88875 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.953748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:43.954406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:43.954692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:43.954973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:43.955746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:43.957338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:43.971938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1070/2133] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:43.971938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:43.981061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa550-4ca9-4c5d-9a52-de63032cc68b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:43.992685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd372fbe106344b5d9b987ae25bf544b4', 'request_id': 'req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.039369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.040081 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.040369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.041238 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.041981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:44.042339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:44.043955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:44.055637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1071/2134] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:44.057174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:44.066608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87f455-ba93-4124-a7ad-3ee86eef2536 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:44.071211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.072124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.072406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.072684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] PATH_INFO: `/v3/projects/cf906900863f4fff90347b8b0efd2fad/users/38a60e4e827040a6a81f76e74a8f1604/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.087443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf906900863f4fff90347b8b0efd2fad, user_id=38a60e4e827040a6a81f76e74a8f1604, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:44.090120 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:44.121373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd372fbe106344b5d9b987ae25bf544b4', 'request_id': 'req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.127594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd372fbe106344b5d9b987ae25bf544b4', 'request_id': 'req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.139235 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] The token cache is being invalidate because project d372fbe106344b5d9b987ae25bf544b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:44.139617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.140350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.141900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1064/2135] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:43 2022] DELETE /identity/v3/projects/d372fbe106344b5d9b987ae25bf544b4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:44.146486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:44.151471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.164080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ead0-5ccb-45b8-bd2a-dbaeb335a02e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:44.170012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.170804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.171134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.171424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.172117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:44.174068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:44.200053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1072/2136] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:44 2022] PUT /identity/v3/projects/cf906900863f4fff90347b8b0efd2fad/users/38a60e4e827040a6a81f76e74a8f1604/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:44.200896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:44.203419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.270869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1065/2137] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:44 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:44.272042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:44.276643 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.300062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b4b32-1882-41e8-b65a-282fd7b09ff7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:44.378282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6474-0c2a-4dff-92e4-d72af1be995b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:44.387147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.388105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.388405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.388688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] PATH_INFO: `/v3/projects/aedcfc9195e84540be2a37612083ed2b` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.390157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aedcfc9195e84540be2a37612083ed2b)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:44.392108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:44.408329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.409914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.410305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.410665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] PATH_INFO: `/v3/users/b04be3cc3dc34a2f95d7ef128904f6d1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.412125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04be3cc3dc34a2f95d7ef128904f6d1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:44.414130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:44.514586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aedcfc9195e84540be2a37612083ed2b', 'request_id': 'req-1c6aa719-9138-46aa-baf3-e97c117bdb46'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.627070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aedcfc9195e84540be2a37612083ed2b', 'request_id': 'req-1c6aa719-9138-46aa-baf3-e97c117bdb46'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.633022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aedcfc9195e84540be2a37612083ed2b', 'request_id': 'req-1c6aa719-9138-46aa-baf3-e97c117bdb46'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.645387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] The token cache is being invalidate because project aedcfc9195e84540be2a37612083ed2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:44.645729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.646385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1c6aa719-9138-46aa-baf3-e97c117bdb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.648100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1066/2138] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:44 2022] DELETE /identity/v3/projects/aedcfc9195e84540be2a37612083ed2b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:44.649711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.650025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.650370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.656796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04be3cc3dc34a2f95d7ef128904f6d1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.666167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04be3cc3dc34a2f95d7ef128904f6d1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.666883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04be3cc3dc34a2f95d7ef128904f6d1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.667555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04be3cc3dc34a2f95d7ef128904f6d1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.679787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] MFA Rules not processed for user `38a60e4e827040a6a81f76e74a8f1604`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:44.679956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-7d96b184-91ea-4d49-9819-77d12bd009fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04be3cc3dc34a2f95d7ef128904f6d1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:44.681023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.750312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1067/2139] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:44.750312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:44.750312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.795955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1073/2140] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:44 2022] DELETE /identity/v3/users/b04be3cc3dc34a2f95d7ef128904f6d1 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:44.798555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.799117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.799914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.818987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:44.821663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.822699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1606-130a-4664-b88a-1ffa3a36fd8a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:44.889516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1074/2141] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:44.890681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:44.892438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:44.906168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.906868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.907152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.907493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:44.908187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:44.910161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:44.952106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d5829-c353-4624-8c6f-1a7de165e31d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:44.955782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4f73b-170e-4b34-b257-cf36e2890165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:44.956428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4f73b-170e-4b34-b257-cf36e2890165 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:44.956736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4f73b-170e-4b34-b257-cf36e2890165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:44.957061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4f73b-170e-4b34-b257-cf36e2890165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.015654 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4f73b-170e-4b34-b257-cf36e2890165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.016995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4f73b-170e-4b34-b257-cf36e2890165 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.026105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1075/2142] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:45.027413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.027733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.028136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.034441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1068/2143] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:44 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:45.038467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.050645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75734ad-de58-4edd-82c9-37c4734b79ff admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.054146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:45.056037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.056881 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.058016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.058445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.058799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.059721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.061474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.066749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1076/2144] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:45.071327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.074182 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1069/2145] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:45.082377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739b641-2d3b-450d-878c-8bc2e1b9efea None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.082514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.088675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.089624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.090085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.090529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.091537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:45.091945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.094210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2329216-d31c-419d-bdc4-cd4932b2096d admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.094527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.101546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.103220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.103220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.104262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.105065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.107287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.112037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1077/2146] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:29:45.116375 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.124051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1070/2147] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:45.128046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.128390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b1e1-5ce3-4180-919a-c41c89bfd9b5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.134119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.136752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.137303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.138096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.138317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50e34-0d89-4b6d-b92d-3d6dd1da0c0a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.139497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.142109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.143816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147c35d-517c-4f0c-9e24-b461dde8828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.144851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147c35d-517c-4f0c-9e24-b461dde8828c admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.145457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147c35d-517c-4f0c-9e24-b461dde8828c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.145457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147c35d-517c-4f0c-9e24-b461dde8828c admin admin] PATH_INFO: `/v3/projects/2f024d11ad3a4dcbb03b71481ff99718/users/85e68334769f42d7b964913354673b65/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.163632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147c35d-517c-4f0c-9e24-b461dde8828c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f024d11ad3a4dcbb03b71481ff99718, user_id=85e68334769f42d7b964913354673b65, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.167012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147c35d-517c-4f0c-9e24-b461dde8828c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.264210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1071/2148] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:45 2022] PUT /identity/v3/projects/2f024d11ad3a4dcbb03b71481ff99718/users/85e68334769f42d7b964913354673b65/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:45.275803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.276106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.276417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.300552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1078/2149] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:45.301599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.304320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.310717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] MFA Rules not processed for user `85e68334769f42d7b964913354673b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:45.311621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.378773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548cff5-b9a8-4926-9c9c-961da6c9d6d8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.384848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.387870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1072/2150] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:45.392359 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.394817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.402094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.402094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] PATH_INFO: `/v3/projects/7a9783c5ef92414aad90cd702acea16c` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.402094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9783c5ef92414aad90cd702acea16c)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.404362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.410654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b08ff-ce05-455b-866a-0a6972d3c5ba None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.424431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.426760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.426760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.426760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.426760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.428488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.544512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1073/2151] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:45.545349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.547806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.598089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9783c5ef92414aad90cd702acea16c', 'request_id': 'req-9ecf579a-2e02-45e1-8d35-cdee66f39729'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:45.605789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9783c5ef92414aad90cd702acea16c', 'request_id': 'req-9ecf579a-2e02-45e1-8d35-cdee66f39729'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:45.637344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0af703-784c-4674-8ad5-baf07aaa5a1f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.640490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9783c5ef92414aad90cd702acea16c', 'request_id': 'req-9ecf579a-2e02-45e1-8d35-cdee66f39729'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:45.686607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.687294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.687566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.687839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.749476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.751284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.762443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1074/2152] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:45.763445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.764141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] The token cache is being invalidate because project 7a9783c5ef92414aad90cd702acea16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:45.764991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:45.765891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9ecf579a-2e02-45e1-8d35-cdee66f39729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:45.768290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1079/2153] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:45 2022] DELETE /identity/v3/projects/7a9783c5ef92414aad90cd702acea16c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:45.772991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.773564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.774091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.798927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:45.800313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.861138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94394d8-a599-46f8-b038-cf8b075ee832 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.866541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e3dcb-7fe9-4f2e-a9cf-51e86a81d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.867212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e3dcb-7fe9-4f2e-a9cf-51e86a81d957 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.867537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e3dcb-7fe9-4f2e-a9cf-51e86a81d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.867808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e3dcb-7fe9-4f2e-a9cf-51e86a81d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.869236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e3dcb-7fe9-4f2e-a9cf-51e86a81d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.871178 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e3dcb-7fe9-4f2e-a9cf-51e86a81d957 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.881922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1080/2154] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:45.884218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1075/2155] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:45.890806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.891933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.892242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.892338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.892685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.906689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce25654-b390-460a-a2ab-334c4f8c72c9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.912477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.913668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.914131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.914733 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.916820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.918692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.930485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1081/2156] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:45.934274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:45.934586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.935781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:45.945215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9431-0e22-44c2-a463-dc0207528e78 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.945411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1076/2157] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:45.949667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:45.956812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a53ab9-4fbf-4956-8fef-88089fc32b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.956812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53ab9-4fbf-4956-8fef-88089fc32b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.956812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53ab9-4fbf-4956-8fef-88089fc32b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.956812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53ab9-4fbf-4956-8fef-88089fc32b0f admin admin] PATH_INFO: `/v3/projects/f350521dcd2c421d8e531791b8f4c0cf/users/73beba58db044d36b3fe8bf4acc18ff9/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.966954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908496b-76eb-471d-a509-4ca927390f6b None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:45.972317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:45.973183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:45.973362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:45.973653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:45.974924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:45.975351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.976167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a53ab9-4fbf-4956-8fef-88089fc32b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f350521dcd2c421d8e531791b8f4c0cf, user_id=73beba58db044d36b3fe8bf4acc18ff9, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:45.977172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.980187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a53ab9-4fbf-4956-8fef-88089fc32b0f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:45.992656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1077/2158] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:45.995578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.005655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0098e0-c6cb-4de8-802b-0177c7809668 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.010337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.020800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.020800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.020800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.020800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.020800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.096228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1082/2159] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:45 2022] PUT /identity/v3/projects/f350521dcd2c421d8e531791b8f4c0cf/users/73beba58db044d36b3fe8bf4acc18ff9/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:46.108474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.108768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.109053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.127736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1078/2160] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:45 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:46.132936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.148444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] MFA Rules not processed for user `73beba58db044d36b3fe8bf4acc18ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:46.149655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:46.195313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e21b84-d5e0-4ca6-9510-f98ec117774d admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.200661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.201331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.201621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.201892 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.202575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.204534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.215327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1083/2161] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:46.312698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1079/2162] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:46 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:46.316883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.328140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d58d8-2c65-4da7-87c0-e92eea27c794 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.332861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.333527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.333811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.334091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.334822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.336556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.347776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1084/2163] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:46.352712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.362954 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c537-166f-4fe6-a58b-b739d4cc5e0e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.367820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.368479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.376091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.376091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.376091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.376091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.381400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1080/2164] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:46.386445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.396354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8a847-e01f-4077-a099-b4a7afc644bb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.402232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8a65-85e2-47a0-b9bb-bd8d5a714f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.403118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8a65-85e2-47a0-b9bb-bd8d5a714f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.403448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8a65-85e2-47a0-b9bb-bd8d5a714f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.403728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8a65-85e2-47a0-b9bb-bd8d5a714f08 admin admin] PATH_INFO: `/v3/projects/40b96ea7758c49cc859b0281cacf7977/users/a204b6ae643a4f778cf974e0119db0bb/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.420548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee8a65-85e2-47a0-b9bb-bd8d5a714f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b96ea7758c49cc859b0281cacf7977, user_id=a204b6ae643a4f778cf974e0119db0bb, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.423239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee8a65-85e2-47a0-b9bb-bd8d5a714f08 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.473238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.479538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:46.505787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1085/2165] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:46 2022] PUT /identity/v3/projects/40b96ea7758c49cc859b0281cacf7977/users/a204b6ae643a4f778cf974e0119db0bb/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:46.526956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.526956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.527107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.540195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18fe4f-cb23-4922-b34f-b6b70846942b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.583800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] MFA Rules not processed for user `a204b6ae643a4f778cf974e0119db0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:46.585511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:46.616670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.617835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.618222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.618796 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.722215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1086/2166] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:46.732499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.757074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.759972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.777955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1081/2167] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:46.846346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e173833-91b9-43f5-ade6-359b87566930 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:46.852643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:46.853937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:46.854609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:46.855008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:46.855794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:46.857982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:46.956478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1087/2168] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:46 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:46.961277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:46.974723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d948da-b0d9-41f4-b772-727323aad249 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.041473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.042269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.042561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.042877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.043888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.045887 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.147828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1082/2169] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:46 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:47.149513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:47.160688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9098d6-0960-4926-a380-9fb97f19ecfb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.165626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.166326 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.166611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.166891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.167685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.169324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.180945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1088/2170] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:47.184967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:47.195504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b38a-150c-450e-8d48-a148e82ff7e3 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.201110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.202006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.202286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.202558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] PATH_INFO: `/v3/projects/4ce2906533e64cf2aae1b777f419bf43/users/f768379cb8d549fabf495c4f647a0b5f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.219332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce2906533e64cf2aae1b777f419bf43, user_id=f768379cb8d549fabf495c4f647a0b5f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.222724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.340233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1083/2171] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:47 2022] PUT /identity/v3/projects/4ce2906533e64cf2aae1b777f419bf43/users/f768379cb8d549fabf495c4f647a0b5f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:47.344372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:47.354900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdfc2-7231-43a4-88d2-0c4bec2dd078 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.417673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.418341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.418623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.418902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.419652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.421246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.431794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1089/2172] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:47.436298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:47.447459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a3f9-bf92-494d-9cc3-583acca02da0 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.453302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ed1ad-0916-4dae-8c7c-7aebeb6aab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.454205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ed1ad-0916-4dae-8c7c-7aebeb6aab1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.454484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ed1ad-0916-4dae-8c7c-7aebeb6aab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.454758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ed1ad-0916-4dae-8c7c-7aebeb6aab1f admin admin] PATH_INFO: `/v3/projects/4ce2906533e64cf2aae1b777f419bf43/users/f768379cb8d549fabf495c4f647a0b5f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.456827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ed1ad-0916-4dae-8c7c-7aebeb6aab1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce2906533e64cf2aae1b777f419bf43, user_id=f768379cb8d549fabf495c4f647a0b5f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.459519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ed1ad-0916-4dae-8c7c-7aebeb6aab1f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.485705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:47.489970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1084/2173] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:47 2022] PUT /identity/v3/projects/4ce2906533e64cf2aae1b777f419bf43/users/f768379cb8d549fabf495c4f647a0b5f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:47.497022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:47.506527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.506920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.507343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.524673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa83f2-869e-4fb1-a7e0-c570eb77392e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.561122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] MFA Rules not processed for user `f768379cb8d549fabf495c4f647a0b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:47.562350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:47.632849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.634010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.635004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.635284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] PATH_INFO: `/v3/users/5dbb99a2a22e4c94828576fdc8aee066` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.636520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbb99a2a22e4c94828576fdc8aee066)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.638503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.648361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1085/2174] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:47.696185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:47.757060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28aac-2061-4fd4-93e6-536dbadd841e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:47.761265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:47.761911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:47.762196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:47.762476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:47.771757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:47.773198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:47.782854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1086/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:47.880676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbb99a2a22e4c94828576fdc8aee066'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:47.887241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbb99a2a22e4c94828576fdc8aee066'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:47.887991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbb99a2a22e4c94828576fdc8aee066'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:47.888719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbb99a2a22e4c94828576fdc8aee066'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:47.900639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbb99a2a22e4c94828576fdc8aee066'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:47.992365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1090/2176] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:47 2022] DELETE /identity/v3/users/5dbb99a2a22e4c94828576fdc8aee066 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:48.359420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:48.383110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2392-cb89-4969-9d46-877827a14bc3 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:48.459759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:48.460647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:48.460929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:48.461207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] PATH_INFO: `/v3/projects/58105e939ccc4750a9676302a6c0eeed` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:48.462500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58105e939ccc4750a9676302a6c0eeed)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:48.465122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:48.531958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:48.533399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:48.546997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119d08-358a-4189-bc83-73eb55e01bf1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:48.551839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:48.552780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:48.553068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:48.553346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] PATH_INFO: `/v3/users/a204b6ae643a4f778cf974e0119db0bb` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:48.554550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a204b6ae643a4f778cf974e0119db0bb)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:48.557108 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:48.623756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58105e939ccc4750a9676302a6c0eeed', 'request_id': 'req-8881e22d-c08f-49ff-9845-6d7680bdaf65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.752868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58105e939ccc4750a9676302a6c0eeed', 'request_id': 'req-8881e22d-c08f-49ff-9845-6d7680bdaf65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.759628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58105e939ccc4750a9676302a6c0eeed', 'request_id': 'req-8881e22d-c08f-49ff-9845-6d7680bdaf65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.771635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] The token cache is being invalidate because project 58105e939ccc4750a9676302a6c0eeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:48.771919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.772688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8881e22d-c08f-49ff-9845-6d7680bdaf65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.774594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1087/2177] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:48 2022] DELETE /identity/v3/projects/58105e939ccc4750a9676302a6c0eeed => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:48.779321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7a6e-a6c7-4454-8461-509016e991f1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:48.779612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7a6e-a6c7-4454-8461-509016e991f1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:48.780393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e7a6e-a6c7-4454-8461-509016e991f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:48.798170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-830e7a6e-a6c7-4454-8461-509016e991f1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:48.799389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-830e7a6e-a6c7-4454-8461-509016e991f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:48.825894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a204b6ae643a4f778cf974e0119db0bb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.835560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a204b6ae643a4f778cf974e0119db0bb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.836293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a204b6ae643a4f778cf974e0119db0bb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.836915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a204b6ae643a4f778cf974e0119db0bb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.851925 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf794eef-ec76-47da-b813-7f8b78aa8da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a204b6ae643a4f778cf974e0119db0bb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:48.881548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1088/2178] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:48.883297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:48.883595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:48.883878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:48.903896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:48.905225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:48.913976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1089/2179] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:48.918419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:48.927533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581ab0b-57d8-41b8-afdf-933b5c9aa0ac None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:48.932373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:48.933104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:48.933384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:48.933654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:48.934446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:48.934675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:48.936324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:48.949135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1090/2180] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:29:48.952803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:48.962413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf15f-9fdb-42b5-b0c5-306326dd475e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:48.968731 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:48.969613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:48.970034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:48.970441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:48.971890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:48.973589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:48.998766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1091/2181] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:48 2022] DELETE /identity/v3/users/a204b6ae643a4f778cf974e0119db0bb => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:29:49.002976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.003305 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.003599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.020861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:49.029497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:49.066190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1091/2182] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:48 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:49.070393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.082501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1092/2183] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:49.092973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.094511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:49.136244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5216c5-4af2-4a73-ae50-dbb887ce29a0 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.141647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.142320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.142606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.142886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.143690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.145620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.171846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ee185-ec62-4ee8-b301-09741ab78b33 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.225137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1092/2184] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:49 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:49.226328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.233620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.234268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.234588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.234870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.238277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d039d2e-5c09-4d73-9499-005a3de8c0ad admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.245367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.246846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.247897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.248692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.249180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.249715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.251836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.252300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.256819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1093/2185] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:29:49.265806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1093/2186] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:49.266950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.276968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea9a8-8d8f-4ce9-9fd4-62e6571218ac service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.281645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629cd9-469b-491a-b6f3-2a2315c7c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.282302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629cd9-469b-491a-b6f3-2a2315c7c302 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.282587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629cd9-469b-491a-b6f3-2a2315c7c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.282865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629cd9-469b-491a-b6f3-2a2315c7c302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.283631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44629cd9-469b-491a-b6f3-2a2315c7c302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.285265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44629cd9-469b-491a-b6f3-2a2315c7c302 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.295933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1094/2187] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:29:49.299981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.310350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8095a-aed7-4ac2-a74a-2c544cc5aa30 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.315332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.316208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.316487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.316759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] PATH_INFO: `/v3/projects/f9ae1a3920c3485da0cc8f5f91108796/users/08b284e21fb24a6181b70c904c22665f/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.337490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ae1a3920c3485da0cc8f5f91108796, user_id=08b284e21fb24a6181b70c904c22665f, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.340835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.427311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1094/2188] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:49 2022] PUT /identity/v3/projects/f9ae1a3920c3485da0cc8f5f91108796/users/08b284e21fb24a6181b70c904c22665f/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:49.432994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.433279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.433584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.451118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:49.452331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:49.524062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1095/2189] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:49.537304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.539114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:49.608307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2439b5-665a-483b-866d-eadd0e8397bd admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.612052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.612884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.613167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.613590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.623675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.625136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.634530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1095/2190] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:49.749040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:49.752708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:49.766975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1fa5-aa37-4444-9e9e-6ad4ed8dd8e6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:49.772813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:49.773339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:49.773797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:49.777163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] PATH_INFO: `/v3/projects/40b96ea7758c49cc859b0281cacf7977` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:49.777163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b96ea7758c49cc859b0281cacf7977)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:49.778279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:49.929515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b96ea7758c49cc859b0281cacf7977', 'request_id': 'req-b4fd9315-e15c-420b-aa6c-30eeced91ebd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:49.934963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b96ea7758c49cc859b0281cacf7977', 'request_id': 'req-b4fd9315-e15c-420b-aa6c-30eeced91ebd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:49.941122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b96ea7758c49cc859b0281cacf7977', 'request_id': 'req-b4fd9315-e15c-420b-aa6c-30eeced91ebd'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.044860 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] The token cache is being invalidate because project 40b96ea7758c49cc859b0281cacf7977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:50.045453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.046366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.048830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1096/2191] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:49 2022] DELETE /identity/v3/projects/40b96ea7758c49cc859b0281cacf7977 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:50.052587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:50.063212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb207-ad0d-4582-9e77-074725a11d0a service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:50.124254 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:50.125116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:50.125403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:50.125679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] PATH_INFO: `/v3/users/f768379cb8d549fabf495c4f647a0b5f` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:50.126905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f768379cb8d549fabf495c4f647a0b5f)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:50.129001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:50.331122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f768379cb8d549fabf495c4f647a0b5f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.346060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f768379cb8d549fabf495c4f647a0b5f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.346768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f768379cb8d549fabf495c4f647a0b5f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.347389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f768379cb8d549fabf495c4f647a0b5f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.433367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4ceba35d-2132-4527-bdc4-69a544a8cb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f768379cb8d549fabf495c4f647a0b5f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:50.449080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1096/2192] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:50 2022] DELETE /identity/v3/users/f768379cb8d549fabf495c4f647a0b5f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:51.182619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:51.184150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:51.197579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9315-e15c-420b-aa6c-30eeced91ebd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:51.286427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:51.287838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:51.288166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:51.288440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] PATH_INFO: `/v3/projects/4ce2906533e64cf2aae1b777f419bf43` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:51.289628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce2906533e64cf2aae1b777f419bf43)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:51.292321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:51.406063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce2906533e64cf2aae1b777f419bf43', 'request_id': 'req-83e7dd09-ed87-4abe-b644-7897f324aa69'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:51.413584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce2906533e64cf2aae1b777f419bf43', 'request_id': 'req-83e7dd09-ed87-4abe-b644-7897f324aa69'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:51.423148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce2906533e64cf2aae1b777f419bf43', 'request_id': 'req-83e7dd09-ed87-4abe-b644-7897f324aa69'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:51.510151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] The token cache is being invalidate because project 4ce2906533e64cf2aae1b777f419bf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:51.510436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:51.511428 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-83e7dd09-ed87-4abe-b644-7897f324aa69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:51.513450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1097/2193] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:51 2022] DELETE /identity/v3/projects/4ce2906533e64cf2aae1b777f419bf43 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:51.518227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:51.518691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:51.518796 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:51.536953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:51.538148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:51.604742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1097/2194] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:51.611945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:51.612572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:51.612910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:51.632276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:51.633751 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:51.643358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1098/2195] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:51.647885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:51.657932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe953cb-99f1-4e48-8198-6c8698279ef5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:51.662763 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:51.663456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:51.663744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:51.664024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:51.664753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:51.665061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:51.667277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:51.685019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1098/2196] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:29:51.689306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:51.698572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac002-1e31-4eac-b8dd-5e383473a259 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:51.703329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:51.703977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:51.704259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:51.705417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:51.705417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:51.707276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:51.851944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1099/2197] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:51 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:51.854035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:51.865351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7005c5-1099-43fe-9019-4b0df1716893 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:51.926472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:51.927149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:51.927588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:51.927873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:51.928566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:51.930535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.037245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1099/2198] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:51 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:52.037333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.045911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d1281-957a-437d-beaa-c3dbcb38f0f6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.050882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.051581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.051886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.052158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.052883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.054538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.067121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1100/2199] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:52.074570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.089253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe022ba-0eea-44d4-867e-6d361e7b8571 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.095118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca104bc-ad99-4119-8573-434193521960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.096218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca104bc-ad99-4119-8573-434193521960 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.096704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca104bc-ad99-4119-8573-434193521960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.097090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca104bc-ad99-4119-8573-434193521960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.098185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca104bc-ad99-4119-8573-434193521960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.100079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca104bc-ad99-4119-8573-434193521960 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.112018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1100/2200] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:52.116453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.130292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e38c9-3a02-4f8e-9b8e-c419192d104f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.136216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.137457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.137846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.138561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] PATH_INFO: `/v3/projects/49e3ae4c66a84d5c82f906ca3db7aece/users/b3903428f50c44a7bef57f5f7ffd5ca5/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.158208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e3ae4c66a84d5c82f906ca3db7aece, user_id=b3903428f50c44a7bef57f5f7ffd5ca5, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.161016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.236684 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1101/2201] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:52 2022] PUT /identity/v3/projects/49e3ae4c66a84d5c82f906ca3db7aece/users/b3903428f50c44a7bef57f5f7ffd5ca5/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:52.238784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.239284 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.239591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.282685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] MFA Rules not processed for user `b3903428f50c44a7bef57f5f7ffd5ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:52.287693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:52.404358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1101/2202] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:52.414708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.541598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b65258-0178-4f77-83f6-f7c2dc2fa743 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.548433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.549436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.549888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.550330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.552691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.553947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.666943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1102/2203] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:52 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:52.670857 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.683073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389f1e-8b95-4bef-8b9b-78dfb9ea04fd None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.762139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.763143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.763651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.764134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.765003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.768039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.881685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1102/2204] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:52 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:52.883049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.894208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff9fd3-7dd8-480b-be96-5289743adcbe admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.898884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.899564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.899845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.900133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.900849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.902434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:52.913105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1103/2205] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:52.918077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:52.928395 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516330c-e97c-4702-a87a-7c18153cbedd admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:52.934799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:52.935738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:52.936019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:52.936290 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] PATH_INFO: `/v3/projects/10b97adcc2764287abbc8d3038d91627/users/36e1e31919bb468eac6df083da4f79ce/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:52.952776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b97adcc2764287abbc8d3038d91627, user_id=36e1e31919bb468eac6df083da4f79ce, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:52.955677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:53.045550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1103/2206] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:52 2022] PUT /identity/v3/projects/10b97adcc2764287abbc8d3038d91627/users/36e1e31919bb468eac6df083da4f79ce/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:53.049888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:53.061257 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e334e7-9fcd-4b24-9975-32dbe23fd8fd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:53.125450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054efc-3b3e-4666-a0e4-e57747716a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:53.126181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054efc-3b3e-4666-a0e4-e57747716a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:53.126465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054efc-3b3e-4666-a0e4-e57747716a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:53.126740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054efc-3b3e-4666-a0e4-e57747716a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:53.127550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054efc-3b3e-4666-a0e4-e57747716a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:53.129140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054efc-3b3e-4666-a0e4-e57747716a5b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:53.141457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1104/2207] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:53.145420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:53.158106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2728-8df0-495a-aef5-51b1b56ae1fe admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:53.163869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:53.164659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:53.165039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:53.165426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] PATH_INFO: `/v3/projects/10b97adcc2764287abbc8d3038d91627/users/36e1e31919bb468eac6df083da4f79ce/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:53.167870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b97adcc2764287abbc8d3038d91627, user_id=36e1e31919bb468eac6df083da4f79ce, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:53.170700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:53.183300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1104/2208] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:53 2022] PUT /identity/v3/projects/10b97adcc2764287abbc8d3038d91627/users/36e1e31919bb468eac6df083da4f79ce/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:53.197620 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:53.198030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:53.198311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:53.229185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] MFA Rules not processed for user `36e1e31919bb468eac6df083da4f79ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:53.230956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:53.320900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1105/2209] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:53.339082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:53.341176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:53.414030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe600-ebf0-4c8a-beb4-29bf0d33e0cc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:53.420641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:53.421918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:53.422204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:53.422495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:53.433263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:53.434930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:53.447883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1105/2210] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:53.610084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:53.620901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c2d10-79a8-4e4e-bf58-3150336686c2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:53.625618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c527f0-90bd-4c83-be75-adf044a5f60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:53.626755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c527f0-90bd-4c83-be75-adf044a5f60e service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:53.627190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c527f0-90bd-4c83-be75-adf044a5f60e service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:53.627713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c527f0-90bd-4c83-be75-adf044a5f60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:53.731780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c527f0-90bd-4c83-be75-adf044a5f60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:53.733877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c527f0-90bd-4c83-be75-adf044a5f60e service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:53.746541 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1106/2211] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:54.334376 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:54.409413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a77d4-1b18-4844-b644-7f3c7c481de9 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:54.414685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:54.415639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:54.416243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:54.416697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] PATH_INFO: `/v3/users/b3903428f50c44a7bef57f5f7ffd5ca5` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:54.422952 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3903428f50c44a7bef57f5f7ffd5ca5)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:54.425215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:54.607754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3903428f50c44a7bef57f5f7ffd5ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:54.621267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3903428f50c44a7bef57f5f7ffd5ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:54.622179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3903428f50c44a7bef57f5f7ffd5ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:54.622843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3903428f50c44a7bef57f5f7ffd5ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:54.709449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3903428f50c44a7bef57f5f7ffd5ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:54.727447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1106/2212] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:54 2022] DELETE /identity/v3/users/b3903428f50c44a7bef57f5f7ffd5ca5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:54.731014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:54.731539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:54.731655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:54.756495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:54.757777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:54.831899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1107/2213] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:54.846231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:54.847909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:54.970506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840190c9-47be-4ee8-97f8-592a0f078ea6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:54.974377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:54.975034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:54.975384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:54.975660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:54.986843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:54.988380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:55.000118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1107/2214] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:55.788887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:55.791582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:55.805859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65b94-60d3-420f-8131-03d54b3eef6b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:55.813459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:55.814919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:55.815457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:55.815939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] PATH_INFO: `/v3/projects/49e3ae4c66a84d5c82f906ca3db7aece` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:55.817390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e3ae4c66a84d5c82f906ca3db7aece)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:55.819501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:55.986184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e3ae4c66a84d5c82f906ca3db7aece', 'request_id': 'req-46ab0995-d18e-44a1-9fa7-63a62ed67892'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:55.993003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e3ae4c66a84d5c82f906ca3db7aece', 'request_id': 'req-46ab0995-d18e-44a1-9fa7-63a62ed67892'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.005406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e3ae4c66a84d5c82f906ca3db7aece', 'request_id': 'req-46ab0995-d18e-44a1-9fa7-63a62ed67892'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.076758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] The token cache is being invalidate because project 49e3ae4c66a84d5c82f906ca3db7aece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:56.077324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.078223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-46ab0995-d18e-44a1-9fa7-63a62ed67892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.080479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1108/2215] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:55 2022] DELETE /identity/v3/projects/49e3ae4c66a84d5c82f906ca3db7aece => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:56.085293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:56.100608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468c155-1495-4311-84a9-39cefbf18101 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:56.172834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:56.173813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:56.174136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:56.174477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] PATH_INFO: `/v3/users/36e1e31919bb468eac6df083da4f79ce` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:56.176406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e1e31919bb468eac6df083da4f79ce)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:56.178439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:56.377545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e1e31919bb468eac6df083da4f79ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.389118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e1e31919bb468eac6df083da4f79ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.389929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e1e31919bb468eac6df083da4f79ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.390529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e1e31919bb468eac6df083da4f79ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.447610 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90472785-be45-4ce2-8800-18fcff03d3a6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:56.447906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90472785-be45-4ce2-8800-18fcff03d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:56.448181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90472785-be45-4ce2-8800-18fcff03d3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:56.461666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e1e31919bb468eac6df083da4f79ce'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:56.495700 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1108/2216] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:29:56 2022] DELETE /identity/v3/users/36e1e31919bb468eac6df083da4f79ce => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:56.498638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-90472785-be45-4ce2-8800-18fcff03d3a6 None None] MFA Rules not processed for user `08b284e21fb24a6181b70c904c22665f`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:56.507809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-90472785-be45-4ce2-8800-18fcff03d3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:56.597115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1109/2217] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:56.610790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:56.612936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:56.698248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5828799-f28b-460f-9f98-f0d2c93fc354 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:56.703986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:56.704645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:56.704932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:56.705211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:56.714430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:56.716061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:56.726211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1109/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:56.983469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:56.984026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:56.984026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.004091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:57.006445 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:57.096357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1110/2219] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:57.097439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:57.099091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:57.161304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:57.163286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:57.178776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99935b-5ea0-4ef9-a60b-15397e9f1856 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:57.187212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:57.188260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.188570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.188817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] PATH_INFO: `/v3/projects/10b97adcc2764287abbc8d3038d91627` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.190311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b97adcc2764287abbc8d3038d91627)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:57.192386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:57.256661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60a568-7b8a-4a30-8441-eb002fcf86d8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:57.266066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a027f2-ea54-433d-bd58-cba84713e653 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:57.266066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a027f2-ea54-433d-bd58-cba84713e653 service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.266066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a027f2-ea54-433d-bd58-cba84713e653 service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.266066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a027f2-ea54-433d-bd58-cba84713e653 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.277105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a027f2-ea54-433d-bd58-cba84713e653 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:57.279367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a027f2-ea54-433d-bd58-cba84713e653 service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:57.288139 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1111/2220] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 16:29:57.306073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b97adcc2764287abbc8d3038d91627', 'request_id': 'req-9dc6bf28-b859-4bce-aa17-5f27014a41ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:57.430464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b97adcc2764287abbc8d3038d91627', 'request_id': 'req-9dc6bf28-b859-4bce-aa17-5f27014a41ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:57.437199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b97adcc2764287abbc8d3038d91627', 'request_id': 'req-9dc6bf28-b859-4bce-aa17-5f27014a41ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:57.451776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] The token cache is being invalidate because project 10b97adcc2764287abbc8d3038d91627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:29:57.452417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:57.456980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9dc6bf28-b859-4bce-aa17-5f27014a41ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:29:57.456980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1110/2221] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:29:57 2022] DELETE /identity/v3/projects/10b97adcc2764287abbc8d3038d91627 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:57.462128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.462505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.467850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.488210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:57.491211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:57.582048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1112/2222] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:57.590724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.591523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.592007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.616594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:57.618213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:57.628332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1111/2223] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:57.639830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:57.650141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126b0c-27ff-49e3-bdd4-883f7a938e0f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:57.657608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:57.658505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.659027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.659480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.661481 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:29:57.661693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:57.664289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:57.684988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1113/2224] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:29:57.686455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:57.697957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45980a48-33a1-4d3b-a6a1-7f28718ab7a9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:57.706060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:57.708894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.708894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.708894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.708894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:57.710459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:57.859617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1112/2225] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:29:57 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:29:57.860210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:57.877885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a4026-3f3a-45bf-97be-b2d4196b5c51 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:57.957401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:57.958272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:57.958814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:57.959321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:57.960194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:57.962347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:58.105863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1114/2226] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:29:57 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:29:58.110259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:58.126833 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a98b-0a92-4844-aa7a-73bdf5e6a47a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:58.171015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:58.171738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.172196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.172625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.173534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:58.176157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:58.206701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1113/2227] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:58.206932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:58.223407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c02ed-9872-4a0f-a48a-52426af7d3d6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:58.231538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06673dd2-f5b4-4967-a074-92ffa261fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:58.233739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06673dd2-f5b4-4967-a074-92ffa261fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.234260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06673dd2-f5b4-4967-a074-92ffa261fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.234842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06673dd2-f5b4-4967-a074-92ffa261fe13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.235771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06673dd2-f5b4-4967-a074-92ffa261fe13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:58.238013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06673dd2-f5b4-4967-a074-92ffa261fe13 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:58.257583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1115/2228] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:29:58.262492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:58.287431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d91cd-e746-45c5-8570-32e306ca68bd admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:58.292854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:58.293760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.294046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.294315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] PATH_INFO: `/v3/projects/79396e9d69b94a84a646ec76604b9979/users/0aa9b91f4efc4499a263e1e2f00bc997/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.311818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79396e9d69b94a84a646ec76604b9979, user_id=0aa9b91f4efc4499a263e1e2f00bc997, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:58.316059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:58.405105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1114/2229] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:29:58 2022] PUT /identity/v3/projects/79396e9d69b94a84a646ec76604b9979/users/0aa9b91f4efc4499a263e1e2f00bc997/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:29:58.410537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e696-f0ef-4613-81be-e876845617e9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.412045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e696-f0ef-4613-81be-e876845617e9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.412045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e696-f0ef-4613-81be-e876845617e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.430652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bd86e696-f0ef-4613-81be-e876845617e9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:58.432553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bd86e696-f0ef-4613-81be-e876845617e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:58.517411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1116/2230] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:58.527430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:58.529798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:58.571163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52109-dead-4769-9f72-875d2897a6f9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.571488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52109-dead-4769-9f72-875d2897a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.571769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52109-dead-4769-9f72-875d2897a6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.600053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-88d52109-dead-4769-9f72-875d2897a6f9 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:58.601515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-88d52109-dead-4769-9f72-875d2897a6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:58.613083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c35fa-d0e9-4ddb-a38c-3a33250e0826 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:58.620816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:58.622278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.624000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.624000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.636822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:58.639868 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:58.662594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1115/2231] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:29:58.673783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1117/2232] 10.222.0.42 () {58 vars in 967 bytes} [Tue May 3 16:29:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:29:58.692733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:58.698330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:58.788032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec11ec-d8f1-4fde-938c-cc6d4edbcfea service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:58.794547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:58.795353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:58.795742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:58.796147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:58.804972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:58.806861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:58.816966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1116/2233] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:29:59.725617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96241a-07a5-4b3b-b764-4c56c0bd25ce None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:59.726128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96241a-07a5-4b3b-b764-4c56c0bd25ce None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:59.727624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96241a-07a5-4b3b-b764-4c56c0bd25ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:59.747575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cf96241a-07a5-4b3b-b764-4c56c0bd25ce None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:29:59.748785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cf96241a-07a5-4b3b-b764-4c56c0bd25ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:29:59.756821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1118/2234] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:29:59.770259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:29:59.781727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeb2e6-d678-4ea6-95df-af5ed856519b service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:29:59.788579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a05fd6-7714-410e-91ae-105eba88ef4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:29:59.789401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05fd6-7714-410e-91ae-105eba88ef4d service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:29:59.789777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05fd6-7714-410e-91ae-105eba88ef4d service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:29:59.790145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a05fd6-7714-410e-91ae-105eba88ef4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:29:59.801717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a05fd6-7714-410e-91ae-105eba88ef4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:29:59.803469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a05fd6-7714-410e-91ae-105eba88ef4d service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:29:59.813196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1117/2235] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:30:00.049051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.049339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.049622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.068520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] MFA Rules not processed for user `08b284e21fb24a6181b70c904c22665f`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:00.071671 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:00.153705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1119/2236] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:00.397096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a494-a1ad-456f-8c24-9d57f34f465e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.397647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a494-a1ad-456f-8c24-9d57f34f465e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.398162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25a494-a1ad-456f-8c24-9d57f34f465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.438704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9c25a494-a1ad-456f-8c24-9d57f34f465e None None] MFA Rules not processed for user `0aa9b91f4efc4499a263e1e2f00bc997`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:00.440716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9c25a494-a1ad-456f-8c24-9d57f34f465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:00.563770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1118/2237] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:00.568222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:00.581397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd2f99-11d3-44dc-a05b-4edae8b321d4 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:00.587050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:00.589452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.589767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.590124 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.590977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:00.597122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:00.624274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.624631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.624919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.644818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:00.646750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:00.655109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1119/2238] 10.222.0.42 () {58 vars in 967 bytes} [Tue May 3 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:30:00.668555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:00.681078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d7861-1b8d-47e9-b1e8-6bc22529da34 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:00.686525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:00.687197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.687516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.687799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.697585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:00.699465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:00.706890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1120/2239] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:00.708319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:00.719471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1120/2240] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 16:30:00.780534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d8a9-b082-427e-be87-5ca78e04e944 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:00.785513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:00.786397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.786681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.786960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.787691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:00.789630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:00.883093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1121/2241] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:00 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:00.883311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:00.891549 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed6217-c0be-4b25-a136-f45e3b96110e service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:00.896260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:00.896933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.897218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.897491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.898210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:00.899820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:00.913750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1121/2242] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:30:00.915319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:00.926119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159043-d98a-49a4-873a-8770bb06c3e0 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:00.930842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:00.933568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:00.933857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:00.934210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] PATH_INFO: `/v3/projects/a6fd59426b794484b38922088d69bafc/users/e45b1f324ab34adfa567b54a751f92eb/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:00.951443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fd59426b794484b38922088d69bafc, user_id=e45b1f324ab34adfa567b54a751f92eb, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:00.954142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:01.090352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1122/2243] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:00 2022] PUT /identity/v3/projects/a6fd59426b794484b38922088d69bafc/users/e45b1f324ab34adfa567b54a751f92eb/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:30:01.094757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:01.130548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c26ae-3b42-434b-a1aa-2b71c05561c4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:01.188534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013c26b-04d6-4ac6-af08-a65c13480954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:01.189357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c26b-04d6-4ac6-af08-a65c13480954 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:01.193459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c26b-04d6-4ac6-af08-a65c13480954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:01.193759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c26b-04d6-4ac6-af08-a65c13480954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:01.194706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c26b-04d6-4ac6-af08-a65c13480954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:01.196261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c26b-04d6-4ac6-af08-a65c13480954 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:01.214020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1122/2244] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:01.214363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:01.256277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9d91d-b116-42fe-9fe6-615b1a88aa0c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:01.262698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:01.263724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:01.264016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:01.264298 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] PATH_INFO: `/v3/projects/a6fd59426b794484b38922088d69bafc/users/e45b1f324ab34adfa567b54a751f92eb/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:01.266378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fd59426b794484b38922088d69bafc, user_id=e45b1f324ab34adfa567b54a751f92eb, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:01.269176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:01.292177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1123/2245] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:01 2022] PUT /identity/v3/projects/a6fd59426b794484b38922088d69bafc/users/e45b1f324ab34adfa567b54a751f92eb/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:02.823577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:02.824142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:02.824142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:02.863475 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] MFA Rules not processed for user `e45b1f324ab34adfa567b54a751f92eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:02.864825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:02.934478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1123/2246] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:02.946269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:02.948302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:03.020030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e78b-f0d8-40eb-9a0b-817f66a85c94 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:03.023576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b43427-8b8f-4b63-9062-30cd55b18768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:03.024217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43427-8b8f-4b63-9062-30cd55b18768 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:03.024501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43427-8b8f-4b63-9062-30cd55b18768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:03.024781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43427-8b8f-4b63-9062-30cd55b18768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:03.079137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b43427-8b8f-4b63-9062-30cd55b18768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:03.080595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b43427-8b8f-4b63-9062-30cd55b18768 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:03.090070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1124/2247] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:06.806370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:06.808753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:06.907147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558052-943e-4032-8e94-4db1ddb0e116 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:06.912059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:06.912927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:06.913800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:06.914084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] PATH_INFO: `/v3/users/85e68334769f42d7b964913354673b65` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:06.915316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e68334769f42d7b964913354673b65)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:06.917228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:07.140944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e68334769f42d7b964913354673b65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:07.152366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e68334769f42d7b964913354673b65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:07.153079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e68334769f42d7b964913354673b65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:07.153729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e68334769f42d7b964913354673b65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:07.233389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e68334769f42d7b964913354673b65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:07.250039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1124/2248] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:06 2022] DELETE /identity/v3/users/85e68334769f42d7b964913354673b65 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:07.251668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:07.252052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:07.252230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:07.290851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:07.292451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:07.361072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1125/2249] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:07.370997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:07.373158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:07.456400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca509c-e4b6-406a-b2b2-4a39c6188680 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:07.460080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06f86-6e5e-4690-94da-8dfbf122b7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:07.460725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06f86-6e5e-4690-94da-8dfbf122b7de service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:07.461003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06f86-6e5e-4690-94da-8dfbf122b7de service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:07.461277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06f86-6e5e-4690-94da-8dfbf122b7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:07.477076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06f86-6e5e-4690-94da-8dfbf122b7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:07.478515 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06f86-6e5e-4690-94da-8dfbf122b7de service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:07.488865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1125/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:07.951833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:07.951833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:07.972776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1230b4-3bb8-4f1e-89ea-e7370aa0b67a None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:07.979114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:07.980025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:07.980309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:07.980590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] PATH_INFO: `/v3/projects/2f024d11ad3a4dcbb03b71481ff99718` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:07.982090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f024d11ad3a4dcbb03b71481ff99718)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:07.984204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.097863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f024d11ad3a4dcbb03b71481ff99718', 'request_id': 'req-b2b1d537-6279-4007-903f-3858e4121684'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:08.104737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f024d11ad3a4dcbb03b71481ff99718', 'request_id': 'req-b2b1d537-6279-4007-903f-3858e4121684'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:08.116194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f024d11ad3a4dcbb03b71481ff99718', 'request_id': 'req-b2b1d537-6279-4007-903f-3858e4121684'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:08.184135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] The token cache is being invalidate because project 2f024d11ad3a4dcbb03b71481ff99718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:08.184453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:08.185132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2b1d537-6279-4007-903f-3858e4121684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:08.186980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1126/2251] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:07 2022] DELETE /identity/v3/projects/2f024d11ad3a4dcbb03b71481ff99718 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:08.193207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.193689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.193794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.233669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:08.234844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:08.291215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1126/2252] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:08.299646 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.300100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.300219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.319374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:08.320574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:08.328641 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1127/2253] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:08.333026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.343761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375ba93-794d-4749-96f5-d01147bfe0bd None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:08.348344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:08.348983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.349294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.349584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.350317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:30:08.350622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:08.352244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.364474 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1127/2254] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:30:08.368690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.377978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f53e-ba0e-40ac-8232-211d66a14ca3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:08.382713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:08.383396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.383700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.383963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.384645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:08.386540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.488080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1128/2255] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:08 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:08.492241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.502819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29e01-3073-42c7-bf26-cb59b5f1ac38 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:08.558112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:08.558769 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.559054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.559364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.560532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:08.562449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.684165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1128/2256] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:08 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:08.688304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.698576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6aefb-a422-4f88-b10f-004a793a9a27 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:08.704058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:08.704709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.704993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.705306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.706017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:08.707652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.719215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1129/2257] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:08.725168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.735397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9e315-324b-4e9e-a41a-4c30cf7ddd73 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:08.740485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b176b6-478c-47e6-811f-9b9a9faab123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:08.741082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b176b6-478c-47e6-811f-9b9a9faab123 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.741361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b176b6-478c-47e6-811f-9b9a9faab123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.741637 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b176b6-478c-47e6-811f-9b9a9faab123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.742355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b176b6-478c-47e6-811f-9b9a9faab123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:08.744001 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b176b6-478c-47e6-811f-9b9a9faab123 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.754154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1129/2258] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:08.758378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.768732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f82d13-3586-4bd1-944d-a398783c1211 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:08.773289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:08.774157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.774438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.774711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] PATH_INFO: `/v3/projects/14d7f5ffaf3448bd89d166b51d0e02bf/users/1b52407210f9489fb1cceec2e4dfd696/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.789459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d7f5ffaf3448bd89d166b51d0e02bf, user_id=1b52407210f9489fb1cceec2e4dfd696, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:08.792094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:08.873051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1130/2259] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:08 2022] PUT /identity/v3/projects/14d7f5ffaf3448bd89d166b51d0e02bf/users/1b52407210f9489fb1cceec2e4dfd696/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:08.883241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:08.889018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:08.889018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:08.911294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] MFA Rules not processed for user `1b52407210f9489fb1cceec2e4dfd696`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:08.912504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:08.980745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1130/2260] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:08.988459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:08.990112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:09.046474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898fa45-1837-4932-a001-6c40bf520e10 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:09.050157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:09.050790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:09.051072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:09.051381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:09.059444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:09.062149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:09.071074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1131/2261] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:13.166219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:13.168218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:13.255950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:13.261540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139eb1a-5199-4880-949b-3f5c79375a78 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:13.265817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de584c-5b32-421f-8641-cc33b6c9384e service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:13.267243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:13.268262 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:13.268548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:13.268848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] PATH_INFO: `/v3/users/951fcc6ad18145bd9c9dbe556c1f7270` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:13.270005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:13.270171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=951fcc6ad18145bd9c9dbe556c1f7270)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:13.270665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:13.270963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:13.271289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:13.272229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:13.273880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:13.337875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:13.339318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48faa47-2dce-464b-ac86-7a52c779e5cb service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:13.349830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1132/2262] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:30:13.508658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951fcc6ad18145bd9c9dbe556c1f7270'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:13.529912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951fcc6ad18145bd9c9dbe556c1f7270'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:13.529912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951fcc6ad18145bd9c9dbe556c1f7270'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:13.529912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951fcc6ad18145bd9c9dbe556c1f7270'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:13.639673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951fcc6ad18145bd9c9dbe556c1f7270'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:13.652570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1131/2263] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:13 2022] DELETE /identity/v3/users/951fcc6ad18145bd9c9dbe556c1f7270 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:13.662322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:13.662609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:13.662889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:13.679622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:13.680819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:13.750277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1133/2264] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:13.760142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:13.761862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:13.829666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e911-3faf-4099-b783-15c8bb5db8ef admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:13.833393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0f0e1-b665-4385-8f6b-0cfd990d2697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:13.834033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0f0e1-b665-4385-8f6b-0cfd990d2697 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:13.834317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0f0e1-b665-4385-8f6b-0cfd990d2697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:13.834594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0f0e1-b665-4385-8f6b-0cfd990d2697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:13.844330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0f0e1-b665-4385-8f6b-0cfd990d2697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:13.845821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0f0e1-b665-4385-8f6b-0cfd990d2697 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:13.871825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1132/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:14.129473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.131058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:14.148970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e0b9c-ba9f-48e5-92fd-b0312896271a None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.150912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.151898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.152287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.152635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] PATH_INFO: `/v3/projects/396b341098504bb4956262d0ae1aabc5` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.153974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396b341098504bb4956262d0ae1aabc5)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.156106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:14.271443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396b341098504bb4956262d0ae1aabc5', 'request_id': 'req-74cfa4ae-8fae-4385-b8d6-1b45beea3153'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:14.278351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396b341098504bb4956262d0ae1aabc5', 'request_id': 'req-74cfa4ae-8fae-4385-b8d6-1b45beea3153'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:14.286006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396b341098504bb4956262d0ae1aabc5', 'request_id': 'req-74cfa4ae-8fae-4385-b8d6-1b45beea3153'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:14.384622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] The token cache is being invalidate because project 396b341098504bb4956262d0ae1aabc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:14.385217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:14.386983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-74cfa4ae-8fae-4385-b8d6-1b45beea3153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:14.393011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1134/2266] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:14 2022] DELETE /identity/v3/projects/396b341098504bb4956262d0ae1aabc5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:14.395303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.395792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.395884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.415708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:14.415708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:14.480291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1133/2267] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:14.488786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.489080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.489359 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.508947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:14.514261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:14.518853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1135/2268] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:14.523051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.532779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51207ad-5677-43f0-a700-d6daa3250ab5 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.537339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.537976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.538253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.538532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.539233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:30:14.539568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.541140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:14.552348 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1134/2269] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:30:14.556453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.566321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2769f-bd2a-497f-8d65-b252659cd5f8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.571029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.571712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.571996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.572271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.572962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.574849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:14.686294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1136/2270] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:14 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:14.690592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.700745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e547-742d-4fa4-b2bd-91823d836590 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.757208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.757870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.758152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.758426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.759105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.761039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:14.868210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1135/2271] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:14 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:14.869366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.880609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468e5e-2ad1-4018-adb7-962a6096f9b5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.885468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.886129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.886408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.886691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.887451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.889093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:14.899868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1137/2272] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:30:14.910166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.920941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516e31-e92c-411f-b988-9ff07bd9c0a7 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.925641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920a657-2052-4212-b1ad-1e615c712776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.926322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920a657-2052-4212-b1ad-1e615c712776 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.926566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920a657-2052-4212-b1ad-1e615c712776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.926841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920a657-2052-4212-b1ad-1e615c712776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.927590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920a657-2052-4212-b1ad-1e615c712776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.929173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920a657-2052-4212-b1ad-1e615c712776 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:14.944616 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1136/2273] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:14.947602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:14.957882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87bbbb-8005-4431-81b1-0fb1b1c644e8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:14.962472 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:14.963390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:14.963674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:14.963951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] PATH_INFO: `/v3/projects/81a8a6f34abb4f4884dc35c6a4cf1d43/users/fe4733f5e72d4a3ab627a4fd80ee76e5/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:14.979019 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a8a6f34abb4f4884dc35c6a4cf1d43, user_id=fe4733f5e72d4a3ab627a4fd80ee76e5, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:14.982334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:15.064661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1138/2274] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:14 2022] PUT /identity/v3/projects/81a8a6f34abb4f4884dc35c6a4cf1d43/users/fe4733f5e72d4a3ab627a4fd80ee76e5/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:15.069589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:15.070046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:15.070335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:15.094200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:15.094200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:15.158786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1137/2275] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:15.168516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:15.170830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:15.242784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be138c-fac8-47fd-b327-455bf3ee2f8f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:15.248308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2d25f-ac04-41db-8c07-62d9f5d0e3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:15.248964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2d25f-ac04-41db-8c07-62d9f5d0e3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:15.249243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2d25f-ac04-41db-8c07-62d9f5d0e3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:15.249510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2d25f-ac04-41db-8c07-62d9f5d0e3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:15.260807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2d25f-ac04-41db-8c07-62d9f5d0e3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:15.262294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2d25f-ac04-41db-8c07-62d9f5d0e3c0 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:15.273014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1139/2276] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:17.727129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:17.729666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:17.755157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05002062-f3bd-414b-bc3a-7a64e7888e4a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:17.781804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:17.783203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:17.784259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:17.784882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] PATH_INFO: `/v3/users/38a60e4e827040a6a81f76e74a8f1604` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:17.790293 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a60e4e827040a6a81f76e74a8f1604)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:17.792294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:18.103443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a60e4e827040a6a81f76e74a8f1604'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:18.135492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a60e4e827040a6a81f76e74a8f1604'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:18.136598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a60e4e827040a6a81f76e74a8f1604'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:18.137405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a60e4e827040a6a81f76e74a8f1604'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:18.235599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a60e4e827040a6a81f76e74a8f1604'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:18.258401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1138/2277] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:17 2022] DELETE /identity/v3/users/38a60e4e827040a6a81f76e74a8f1604 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:18.271643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e0af-f636-467c-908e-88e645558358 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:18.274067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e0af-f636-467c-908e-88e645558358 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:18.274067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e0af-f636-467c-908e-88e645558358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:18.308720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-2592e0af-f636-467c-908e-88e645558358 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:18.313457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2592e0af-f636-467c-908e-88e645558358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:18.417675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1140/2278] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:18.446502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:18.449443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:18.557365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54017c-3d38-4fbc-b349-ced05a6667f5 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:18.561634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c35009-33f6-4372-805f-0b99a7235f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:18.562289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c35009-33f6-4372-805f-0b99a7235f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:18.562574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c35009-33f6-4372-805f-0b99a7235f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:18.562895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c35009-33f6-4372-805f-0b99a7235f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:18.573198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c35009-33f6-4372-805f-0b99a7235f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:18.574445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c35009-33f6-4372-805f-0b99a7235f28 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:18.588312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1139/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:19.116349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e0af-f636-467c-908e-88e645558358 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:19.116349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2592e0af-f636-467c-908e-88e645558358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:19.127626 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e0af-f636-467c-908e-88e645558358 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:19.137493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:19.139053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:19.139489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:19.139839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] PATH_INFO: `/v3/projects/cf906900863f4fff90347b8b0efd2fad` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:19.141296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf906900863f4fff90347b8b0efd2fad)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:19.143521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:19.300232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf906900863f4fff90347b8b0efd2fad', 'request_id': 'req-581b545c-de9d-4937-be95-b59a6a55e55e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:19.307948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf906900863f4fff90347b8b0efd2fad', 'request_id': 'req-581b545c-de9d-4937-be95-b59a6a55e55e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:19.315288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf906900863f4fff90347b8b0efd2fad', 'request_id': 'req-581b545c-de9d-4937-be95-b59a6a55e55e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:19.399528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] The token cache is being invalidate because project cf906900863f4fff90347b8b0efd2fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:19.399875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:19.402677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:19.403844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1141/2280] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:19 2022] DELETE /identity/v3/projects/cf906900863f4fff90347b8b0efd2fad => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:21.502707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:21.503292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:21.503292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:21.537581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] MFA Rules not processed for user `fe4733f5e72d4a3ab627a4fd80ee76e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:21.538999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:21.612007 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1140/2281] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:30:21.616450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:21.617904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:21.684709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b545c-de9d-4937-be95-b59a6a55e55e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:21.690178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:21.690880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:21.691338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:21.691614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:21.692392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:21.694314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:21.786719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1142/2282] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:21 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:21.790794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:21.803181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cef9fa-51d5-4e60-8729-1e640ceceb4e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:21.868038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:21.868925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:21.869261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:21.869540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:21.870236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:21.872325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:21.970294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1141/2283] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:21 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:21.971600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:21.983474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b5648-1dad-4bec-b3f6-b161795df0b2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:21.988281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:21.989016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:21.989369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:21.989720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:21.990519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:21.992257 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:22.003630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1143/2284] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:30:22.007758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:22.019234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527acd42-ecf8-4ef7-b0c8-0f1a2646fd67 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:22.024401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:22.025283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:22.025567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:22.025842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] PATH_INFO: `/v3/projects/c5bcac88c21b4fe6a3b0b3abd5a9173f/users/e1759889a4bb401fa1b1fb27c9a4a132/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:22.041072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bcac88c21b4fe6a3b0b3abd5a9173f, user_id=e1759889a4bb401fa1b1fb27c9a4a132, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:22.043749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:22.154471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1142/2285] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:22 2022] PUT /identity/v3/projects/c5bcac88c21b4fe6a3b0b3abd5a9173f/users/e1759889a4bb401fa1b1fb27c9a4a132/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:22.157870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:22.168203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026490e4-d03d-4b88-ab47-c6e17761ec52 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:22.249353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d177-d021-4f46-8791-545e8a20f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:22.250429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d177-d021-4f46-8791-545e8a20f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:22.250899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d177-d021-4f46-8791-545e8a20f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:22.251350 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d177-d021-4f46-8791-545e8a20f7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:22.252372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d177-d021-4f46-8791-545e8a20f7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:22.254540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d177-d021-4f46-8791-545e8a20f7f0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:22.267041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1144/2286] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:22.271042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:22.283448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab3992-f066-4db6-be2f-169049c0387c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:22.290459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:22.291328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:22.291610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:22.291882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] PATH_INFO: `/v3/projects/c5bcac88c21b4fe6a3b0b3abd5a9173f/users/e1759889a4bb401fa1b1fb27c9a4a132/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:22.293933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bcac88c21b4fe6a3b0b3abd5a9173f, user_id=e1759889a4bb401fa1b1fb27c9a4a132, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:22.296759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:22.312781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1143/2287] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:22 2022] PUT /identity/v3/projects/c5bcac88c21b4fe6a3b0b3abd5a9173f/users/e1759889a4bb401fa1b1fb27c9a4a132/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:30:29.193676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:29.194237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:29.194525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:29.225237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] MFA Rules not processed for user `e1759889a4bb401fa1b1fb27c9a4a132`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:29.226468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:29.314859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1145/2288] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:29.327292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:29.330072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:29.422553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bab63-97d8-4ca6-980c-39ec3959dcd6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:29.430289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58337722-6276-4857-a266-c06b4c09a84a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:29.431079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58337722-6276-4857-a266-c06b4c09a84a service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:29.431509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58337722-6276-4857-a266-c06b4c09a84a service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:29.431913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58337722-6276-4857-a266-c06b4c09a84a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:29.520407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58337722-6276-4857-a266-c06b4c09a84a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:29.522120 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58337722-6276-4857-a266-c06b4c09a84a service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:29.535028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1144/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:30:34.076696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:34.078714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:34.156937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869e65b-6863-48c2-9263-c40e6ee75fed None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:34.162218 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:34.163114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:34.163460 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:34.163828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] PATH_INFO: `/v3/users/73beba58db044d36b3fe8bf4acc18ff9` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:34.165029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73beba58db044d36b3fe8bf4acc18ff9)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:34.167080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:34.368589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73beba58db044d36b3fe8bf4acc18ff9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:34.377213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73beba58db044d36b3fe8bf4acc18ff9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:34.378421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73beba58db044d36b3fe8bf4acc18ff9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:34.379068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73beba58db044d36b3fe8bf4acc18ff9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:34.405443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73beba58db044d36b3fe8bf4acc18ff9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:34.497961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1146/2290] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:34 2022] DELETE /identity/v3/users/73beba58db044d36b3fe8bf4acc18ff9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:34.506249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:34.506737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:34.507696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:34.529951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:34.531294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:34.613255 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1145/2291] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:34.627475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:34.630397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:34.706403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354d8e0-13f4-4548-9420-c3852fe1425a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:34.711544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806c269-9217-4c10-a916-f14414534893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:34.712212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806c269-9217-4c10-a916-f14414534893 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:34.712687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806c269-9217-4c10-a916-f14414534893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:34.712812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806c269-9217-4c10-a916-f14414534893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:34.722907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806c269-9217-4c10-a916-f14414534893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:34.724389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806c269-9217-4c10-a916-f14414534893 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:34.734818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1147/2292] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:35.255400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:35.257242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:35.277795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11039b31-5a1e-4a07-8186-e86e96597faf None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:35.283578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:35.284451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:35.284898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:35.285176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] PATH_INFO: `/v3/projects/f350521dcd2c421d8e531791b8f4c0cf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:35.286682 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f350521dcd2c421d8e531791b8f4c0cf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:35.288620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:35.394934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f350521dcd2c421d8e531791b8f4c0cf', 'request_id': 'req-280808f0-50ab-4d61-851d-66e5fe633325'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:35.481365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f350521dcd2c421d8e531791b8f4c0cf', 'request_id': 'req-280808f0-50ab-4d61-851d-66e5fe633325'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:35.488316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f350521dcd2c421d8e531791b8f4c0cf', 'request_id': 'req-280808f0-50ab-4d61-851d-66e5fe633325'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:35.502565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] The token cache is being invalidate because project f350521dcd2c421d8e531791b8f4c0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:35.503292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:35.504566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-280808f0-50ab-4d61-851d-66e5fe633325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:35.506301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1146/2293] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:35 2022] DELETE /identity/v3/projects/f350521dcd2c421d8e531791b8f4c0cf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:30:35.511516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9d14e-5689-463b-8297-396bff249614 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:35.511973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9d14e-5689-463b-8297-396bff249614 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:35.512184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9d14e-5689-463b-8297-396bff249614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:35.543939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-78a9d14e-5689-463b-8297-396bff249614 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:35.545629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-78a9d14e-5689-463b-8297-396bff249614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:35.607888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1148/2294] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:30:35.615912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:35.616206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:35.616673 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:35.635831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:35.637030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:35.646159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1147/2295] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:35.650717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9d14e-5689-463b-8297-396bff249614 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:35.661038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9d14e-5689-463b-8297-396bff249614 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:35.665771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:35.666426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:35.666708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:35.666989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:35.667808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:30:35.668166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:35.670412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:35.682766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1149/2296] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:30:35.688002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:35.697386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621fa5c-b070-4b96-9ddf-157deb1a9f21 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:35.702346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:35.705317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:35.705317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:35.705317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:35.705317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:35.706209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:35.819837 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1148/2297] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:35 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:35.824193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:35.834396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78767b1-1cf8-4775-8a74-7bb56247032b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:35.891806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:35.892555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:35.892853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:35.893132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:35.893886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:35.895864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:36.029309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1150/2298] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:35 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:36.033072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:36.043936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4a4f-55dd-499c-ac82-a2d41e31145a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:36.050223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:36.057184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:36.057538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:36.057817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:36.062303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:36.064304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:36.080904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1149/2299] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:36.085011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:36.096061 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d55d6-8cc9-4df0-8c3d-34e525a167af admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:36.113653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11650d9-07e7-49e2-83a2-4b1282f1d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:36.114341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11650d9-07e7-49e2-83a2-4b1282f1d41e admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:36.114644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11650d9-07e7-49e2-83a2-4b1282f1d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:36.114923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11650d9-07e7-49e2-83a2-4b1282f1d41e admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:36.115699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11650d9-07e7-49e2-83a2-4b1282f1d41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:36.117316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11650d9-07e7-49e2-83a2-4b1282f1d41e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:36.133152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1151/2300] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:36.143131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:36.152946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7df7-97b5-44ea-93ff-5017ba4491c4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:36.158459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:36.159366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:36.159672 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:36.159969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] PATH_INFO: `/v3/projects/dc7084a94b2e41dba69f93f5644f7416/users/f97efaeb162941f9a173c0852ae7f2da/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:36.254035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7084a94b2e41dba69f93f5644f7416, user_id=f97efaeb162941f9a173c0852ae7f2da, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:36.254035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:36.567965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1150/2301] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:36 2022] PUT /identity/v3/projects/dc7084a94b2e41dba69f93f5644f7416/users/f97efaeb162941f9a173c0852ae7f2da/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:36.613135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:36.613614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:36.613726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:36.655179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] MFA Rules not processed for user `f97efaeb162941f9a173c0852ae7f2da`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:36.656474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:36.731559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1152/2302] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:36.736338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:36.824666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c539c-57fe-43db-87f8-c64784ac8e2b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:36.829429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:36.830082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:36.830362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:36.830641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:36.831347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:36.833247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:36.973533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1151/2303] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:36.977370 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:36.992634 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f66be-87bf-4438-8d9c-357f9d4181e1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.064041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.072332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.072332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.072332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.072332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.072332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.182396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1153/2304] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:36 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:37.186177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.196358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739d87-61a7-4f82-bfbf-88b618bb20fa admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.201664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.202344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.202817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.203095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.203883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.205490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.218400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1152/2305] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:37.222704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.233304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622be313-5201-4fb1-a86a-52ebdf0b21ba admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.238121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbe94c-ea14-4cc4-868c-acce3d38dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.238796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbe94c-ea14-4cc4-868c-acce3d38dfda admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.239145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbe94c-ea14-4cc4-868c-acce3d38dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.239443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbe94c-ea14-4cc4-868c-acce3d38dfda admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.240287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbe94c-ea14-4cc4-868c-acce3d38dfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.241927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbe94c-ea14-4cc4-868c-acce3d38dfda admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.253662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1154/2306] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:37.256553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.267193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3558-5878-4823-83a1-d85930552fea admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.272149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.273081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.273524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.273770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] PATH_INFO: `/v3/projects/5fd70fdcfd2745468974f91c0654aefd/users/7327cd0fda004e278c1c815c08d0cff2/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.291417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd70fdcfd2745468974f91c0654aefd, user_id=7327cd0fda004e278c1c815c08d0cff2, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.294196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.393918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1153/2307] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:37 2022] PUT /identity/v3/projects/5fd70fdcfd2745468974f91c0654aefd/users/7327cd0fda004e278c1c815c08d0cff2/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:37.405662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.405952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.406228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.432754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] MFA Rules not processed for user `7327cd0fda004e278c1c815c08d0cff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:37.433979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:37.505364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1155/2308] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:37.516391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.586996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed920755-8cab-4482-a2b7-23ad3543a55b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.591962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.592878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.593162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.593439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.594132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.596081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.707558 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1154/2309] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:37 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:37.707758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.715831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e672e-1b02-404b-98b7-93308dbea19b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.776347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.777036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.777313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.777586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.778289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.780435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.890593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1156/2310] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:37 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:37.894670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.905780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750cac-e43b-4985-94e4-9475d7d54fc3 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.911187 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.911888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.912166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.912443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.913249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.914862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:37.926478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1155/2311] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:37.931034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:37.941989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1fdd9-2b72-4dbb-b106-01ea16360b7d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:37.948240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:37.948378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:37.948769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:37.949058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] PATH_INFO: `/v3/projects/4c871e8fa3624d42b96d46b309e58147/users/c00701435bff431a9c01dc4d2ce3b4f4/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:37.971346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c871e8fa3624d42b96d46b309e58147, user_id=c00701435bff431a9c01dc4d2ce3b4f4, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:37.972999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:38.072964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1157/2312] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:37 2022] PUT /identity/v3/projects/4c871e8fa3624d42b96d46b309e58147/users/c00701435bff431a9c01dc4d2ce3b4f4/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:38.077355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:38.092748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fcf5b-c37f-4259-b7bd-cf5f42b2a59a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:38.156663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f778b7d-ddf0-41e8-aef4-f42978a78fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:38.157331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f778b7d-ddf0-41e8-aef4-f42978a78fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:38.157610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f778b7d-ddf0-41e8-aef4-f42978a78fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:38.157911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f778b7d-ddf0-41e8-aef4-f42978a78fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:38.158631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f778b7d-ddf0-41e8-aef4-f42978a78fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:38.160283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f778b7d-ddf0-41e8-aef4-f42978a78fd3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:38.174827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1156/2313] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:30:38.180256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:38.190877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c241ab-d2d8-4016-bc8f-5fcd65d6c620 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:38.195917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:38.201921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:38.201921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:38.201921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] PATH_INFO: `/v3/projects/4c871e8fa3624d42b96d46b309e58147/users/c00701435bff431a9c01dc4d2ce3b4f4/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:38.201921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c871e8fa3624d42b96d46b309e58147, user_id=c00701435bff431a9c01dc4d2ce3b4f4, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:38.203027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:38.213607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1158/2314] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:38 2022] PUT /identity/v3/projects/4c871e8fa3624d42b96d46b309e58147/users/c00701435bff431a9c01dc4d2ce3b4f4/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:38.227912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6676ce-f557-40ba-ba0a-4eb0db70a615 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:38.228044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6676ce-f557-40ba-ba0a-4eb0db70a615 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:38.229544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6676ce-f557-40ba-ba0a-4eb0db70a615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:38.268656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0d6676ce-f557-40ba-ba0a-4eb0db70a615 None None] MFA Rules not processed for user `c00701435bff431a9c01dc4d2ce3b4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:38.269880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0d6676ce-f557-40ba-ba0a-4eb0db70a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:38.372745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1157/2315] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:38.383160 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:38.385035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:38.478847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535e85-f563-40d7-9958-377aa0cca956 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:38.483033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:38.483718 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:38.484002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:38.484302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:38.565333 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:38.567059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:38.588603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1159/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:39.608416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:39.608869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:39.608985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:39.626983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] MFA Rules not processed for user `b6e168c909c64a48bcc2762081ed0658`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:39.628236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:39.693651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1158/2317] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:41.911223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:41.913234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:41.917286 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:41.921349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:41.928814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ff750-a490-4eaa-bb28-0797084f7ad0 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:41.943303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:41.943303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:41.943303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:41.943303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:42.007924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030323-c206-4c17-b62a-4aa47d966cd7 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:42.012394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:42.013531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:42.013820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:42.014095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] PATH_INFO: `/v3/users/0aa9b91f4efc4499a263e1e2f00bc997` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:42.015387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa9b91f4efc4499a263e1e2f00bc997)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:42.017084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:42.017329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:42.018559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:42.027747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1160/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:42.220687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa9b91f4efc4499a263e1e2f00bc997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.232428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa9b91f4efc4499a263e1e2f00bc997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.233084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa9b91f4efc4499a263e1e2f00bc997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.233681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa9b91f4efc4499a263e1e2f00bc997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.335905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa9b91f4efc4499a263e1e2f00bc997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.350305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1159/2319] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:41 2022] DELETE /identity/v3/users/0aa9b91f4efc4499a263e1e2f00bc997 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:42.620214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:42.631767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3f3a-5afe-48ee-aa6d-7ff25cb16af3 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:42.704917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:42.705784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:42.706188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:42.706475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] PATH_INFO: `/v3/projects/79396e9d69b94a84a646ec76604b9979` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:42.707725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79396e9d69b94a84a646ec76604b9979)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:42.709658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:42.829132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79396e9d69b94a84a646ec76604b9979', 'request_id': 'req-64323074-8c1d-41c5-bc68-6be5bc960e68'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.834528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79396e9d69b94a84a646ec76604b9979', 'request_id': 'req-64323074-8c1d-41c5-bc68-6be5bc960e68'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:42.840708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79396e9d69b94a84a646ec76604b9979', 'request_id': 'req-64323074-8c1d-41c5-bc68-6be5bc960e68'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.012531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] The token cache is being invalidate because project 79396e9d69b94a84a646ec76604b9979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:43.014328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.014959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.016657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1161/2320] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:42 2022] DELETE /identity/v3/projects/79396e9d69b94a84a646ec76604b9979 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:43.020679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:43.022150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:43.049328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0804e-ec26-4436-9512-9030f7b3a582 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:43.123838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:43.124821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:43.125104 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:43.125526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] PATH_INFO: `/v3/users/e45b1f324ab34adfa567b54a751f92eb` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:43.127026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45b1f324ab34adfa567b54a751f92eb)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:43.129536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:43.345614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45b1f324ab34adfa567b54a751f92eb'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.365866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45b1f324ab34adfa567b54a751f92eb'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.366460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45b1f324ab34adfa567b54a751f92eb'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.367067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45b1f324ab34adfa567b54a751f92eb'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.456169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45b1f324ab34adfa567b54a751f92eb'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:43.469597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1160/2321] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:43 2022] DELETE /identity/v3/users/e45b1f324ab34adfa567b54a751f92eb => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:43.802462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:43.803926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:43.817316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64323074-8c1d-41c5-bc68-6be5bc960e68 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:43.857641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:43.857641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:43.923870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:43.925042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:43.925420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:43.926140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] PATH_INFO: `/v3/projects/a6fd59426b794484b38922088d69bafc` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:43.926943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad950f-cbf2-408a-b23a-e7428e985c4c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:43.927053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fd59426b794484b38922088d69bafc)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:43.928942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:43.930764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:43.931527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:43.931674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:43.931824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:43.933726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:44.007835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.009270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d481e-d601-48f7-899e-895986770f9c service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:44.019095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1161/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:30:44.146864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fd59426b794484b38922088d69bafc', 'request_id': 'req-62105ec1-ae08-4974-bf3e-6e8cc9878342'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:44.153115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fd59426b794484b38922088d69bafc', 'request_id': 'req-62105ec1-ae08-4974-bf3e-6e8cc9878342'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:44.160933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fd59426b794484b38922088d69bafc', 'request_id': 'req-62105ec1-ae08-4974-bf3e-6e8cc9878342'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:44.247597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] The token cache is being invalidate because project a6fd59426b794484b38922088d69bafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:44.247890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:44.251837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-62105ec1-ae08-4974-bf3e-6e8cc9878342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:44.251837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1162/2323] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:43 2022] DELETE /identity/v3/projects/a6fd59426b794484b38922088d69bafc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:44.256513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.257037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.257037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.277622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:44.279560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:44.391662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1162/2324] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:44.399608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.399908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.400193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.422237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:44.427149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:44.436444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1163/2325] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:44.438694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:44.450098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49199189-c883-4fdc-a032-b009bb9c30bf None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:44.456650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:44.457567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.458050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.458496 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.459608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:30:44.460113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.462333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:44.478385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1163/2326] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:30:44.483040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:44.492307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0e6a9-583b-43b2-8861-f70a18028e37 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:44.498972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:44.499911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.500517 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.500797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.501512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.503722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:44.599947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1164/2327] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:44 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:44.604090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:44.615913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e8ff-26db-4da5-a8e9-a13640504774 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:44.678993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:44.679710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.679980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.680257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.680946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.682860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:44.824306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1164/2328] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:44 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:44.826403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:44.837183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d535ff8-8cc8-4c58-8f23-0a26325499f4 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:44.843113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:44.850954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.850954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.850954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.850954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.850954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:44.858044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1165/2329] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:30:44.862307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:44.873374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388555a-4562-42e6-849c-4c2bd9d9a19e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:44.879220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5dab5-dbc2-42ab-a924-8d69ef38c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:44.883749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dab5-dbc2-42ab-a924-8d69ef38c61c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.883749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dab5-dbc2-42ab-a924-8d69ef38c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.883749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dab5-dbc2-42ab-a924-8d69ef38c61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.883749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5dab5-dbc2-42ab-a924-8d69ef38c61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.883749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5dab5-dbc2-42ab-a924-8d69ef38c61c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:44.894659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1165/2330] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:44.899084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:44.909691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f520c-ce98-46e0-97a5-0ab2b7b9d9a9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:44.916223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:44.917150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:44.917449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:44.917709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] PATH_INFO: `/v3/projects/0d10da3e2e984480b06841352f1f3246/users/17f414f8e6224ad3be85aa5a10fc3b3e/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:44.941853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d10da3e2e984480b06841352f1f3246, user_id=17f414f8e6224ad3be85aa5a10fc3b3e, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:44.954723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:45.056210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1166/2331] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:44 2022] PUT /identity/v3/projects/0d10da3e2e984480b06841352f1f3246/users/17f414f8e6224ad3be85aa5a10fc3b3e/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:30:45.068955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:45.070055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:45.070358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:45.106318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] MFA Rules not processed for user `17f414f8e6224ad3be85aa5a10fc3b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:45.108322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:45.227427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1166/2332] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:30:45.230244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:45.305818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd7c11-11a8-436b-bd1d-7a8e9fea2104 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:45.310981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:45.311725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:45.311945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:45.312197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:45.312921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:45.314830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:45.444456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1167/2333] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:45 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:45.445612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:45.467935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9d6d6-0706-4a69-a1db-8dcd0d518560 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:45.663463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:45.664159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:45.664448 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:45.666025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:45.666437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:45.671925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:45.791174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:45.793210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1167/2334] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:45 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:45.807150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987ed5-f6ef-4d7c-9e40-917d1875c152 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:45.816253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:45.816253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:45.816253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:45.816253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:45.817366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:45.823941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:45.840373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1168/2335] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:45.848457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:45.859231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa904c4-4399-46c7-adb1-f8346e73011e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:45.871246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433208ff-3410-49cc-a972-4d31087a9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:45.874346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433208ff-3410-49cc-a972-4d31087a9ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:45.874346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433208ff-3410-49cc-a972-4d31087a9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:45.874625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433208ff-3410-49cc-a972-4d31087a9ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:45.875382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433208ff-3410-49cc-a972-4d31087a9ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:45.876996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433208ff-3410-49cc-a972-4d31087a9ec0 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:45.888724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1168/2336] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:45.898983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:45.912006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cba1-8d7e-464b-98c4-b16066cf51eb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:45.918212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:45.919170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:45.919503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:45.919964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] PATH_INFO: `/v3/projects/4c880ca880e341059f13db99244aa386/users/1edfaea696df46f4b6e19a0d0217bd65/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:45.940055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c880ca880e341059f13db99244aa386, user_id=1edfaea696df46f4b6e19a0d0217bd65, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:45.942433 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:46.028769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1169/2337] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:45 2022] PUT /identity/v3/projects/4c880ca880e341059f13db99244aa386/users/1edfaea696df46f4b6e19a0d0217bd65/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:46.040285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:46.040846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:46.041154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:46.093681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] MFA Rules not processed for user `1edfaea696df46f4b6e19a0d0217bd65`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:46.094891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:46.185546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1169/2338] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:46.199528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:46.295508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df0fd9-4c21-4c61-848c-99ff005e8b80 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:46.307060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:46.308217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:46.308965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:46.309437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:46.311357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:46.314152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:46.424163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1170/2339] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:46 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:46.428364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:46.449883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4620f7-2619-46ba-82a1-22fe5957e6c9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:46.536467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:46.537141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:46.537609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:46.538110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:46.538958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:46.543872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:46.689736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1170/2340] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:46 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:46.692583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:46.703506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7eda-5d9f-4c58-b9f1-c7a6411c9b85 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:46.708346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:46.709442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:46.709788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:46.710070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:46.711171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:46.713430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:46.729787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1171/2341] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:30:46.734460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:46.747352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dde80-ca1b-4bce-bbb1-c0d81c63485f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:46.752943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:46.754180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:46.754457 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:46.754914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] PATH_INFO: `/v3/projects/0da77d65f5ef4f44b184a7f3e0efbec8/users/d521868b4e334e3fbd33a9d63ab3e1ba/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:46.771897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da77d65f5ef4f44b184a7f3e0efbec8, user_id=d521868b4e334e3fbd33a9d63ab3e1ba, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:46.774536 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:46.944334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1171/2342] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:46 2022] PUT /identity/v3/projects/0da77d65f5ef4f44b184a7f3e0efbec8/users/d521868b4e334e3fbd33a9d63ab3e1ba/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:46.956143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:46.968015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51cc9c-e751-4bdb-b463-a5599a90e3f0 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:47.037227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1ad85-02ec-4ea3-9ba7-e8f48034bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:47.037905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1ad85-02ec-4ea3-9ba7-e8f48034bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:47.038191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1ad85-02ec-4ea3-9ba7-e8f48034bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:47.038469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1ad85-02ec-4ea3-9ba7-e8f48034bc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:47.039202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1ad85-02ec-4ea3-9ba7-e8f48034bc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:47.040877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1ad85-02ec-4ea3-9ba7-e8f48034bc89 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:47.054959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1172/2343] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:47.056477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:47.071540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da1b1-13df-4524-a659-46fd02286f15 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:47.077303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:47.078328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:47.078739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:47.079324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] PATH_INFO: `/v3/projects/0da77d65f5ef4f44b184a7f3e0efbec8/users/d521868b4e334e3fbd33a9d63ab3e1ba/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:47.084476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da77d65f5ef4f44b184a7f3e0efbec8, user_id=d521868b4e334e3fbd33a9d63ab3e1ba, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:47.087387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:47.104446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1172/2344] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:47 2022] PUT /identity/v3/projects/0da77d65f5ef4f44b184a7f3e0efbec8/users/d521868b4e334e3fbd33a9d63ab3e1ba/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:47.114926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:47.115215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:47.115578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:47.149039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] MFA Rules not processed for user `d521868b4e334e3fbd33a9d63ab3e1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:47.150318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:47.224346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1173/2345] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:47.235962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:47.237772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:47.302777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742e2f-e572-4d38-857c-8f457e4e6189 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:47.306926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:47.315640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:47.315640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:47.315640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:47.370812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:47.372623 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:47.382248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1173/2346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:50.390096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:50.391526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:50.463380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c3439-b213-4e0c-a07a-a9c6317b21d2 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:50.470871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:50.471799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:50.472077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:50.472391 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] PATH_INFO: `/v3/users/f97efaeb162941f9a173c0852ae7f2da` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:50.473673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97efaeb162941f9a173c0852ae7f2da)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:50.475682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:50.592739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:50.601752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42f1a-c527-4f2e-808b-8ae63e68a0a4 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:50.605914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53b7c7-adc8-48f1-bd7c-9719f3c11853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:50.607427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b7c7-adc8-48f1-bd7c-9719f3c11853 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:50.607721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b7c7-adc8-48f1-bd7c-9719f3c11853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:50.607999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b7c7-adc8-48f1-bd7c-9719f3c11853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:50.679871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53b7c7-adc8-48f1-bd7c-9719f3c11853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:50.681404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53b7c7-adc8-48f1-bd7c-9719f3c11853 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:50.694424 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1174/2347] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:50.712156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97efaeb162941f9a173c0852ae7f2da'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:50.729437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97efaeb162941f9a173c0852ae7f2da'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:50.730186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97efaeb162941f9a173c0852ae7f2da'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:50.730797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97efaeb162941f9a173c0852ae7f2da'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:50.744335 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97efaeb162941f9a173c0852ae7f2da'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:50.828734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1174/2348] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:50 2022] DELETE /identity/v3/users/f97efaeb162941f9a173c0852ae7f2da => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:50.834703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:50.834995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:50.835316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:50.859072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:50.860330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:50.937242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1175/2349] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:50.950639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:50.953609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:51.021617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ce95-2e87-4e2a-bb9b-18fdd7f3377a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:51.025432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:51.032147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:51.032147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:51.032147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:51.036581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:51.038027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:51.053212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1175/2350] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:51.550221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:51.551755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:51.568261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c612d4-f82d-4342-ad32-50dc589e4c10 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:51.573601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:51.574530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:51.574864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:51.575129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] PATH_INFO: `/v3/projects/dc7084a94b2e41dba69f93f5644f7416` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:51.576604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7084a94b2e41dba69f93f5644f7416)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:51.582727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:51.715961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7084a94b2e41dba69f93f5644f7416', 'request_id': 'req-1ef2d58e-00ec-4aa8-bccd-96318bc82824'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:51.806176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7084a94b2e41dba69f93f5644f7416', 'request_id': 'req-1ef2d58e-00ec-4aa8-bccd-96318bc82824'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:51.813412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7084a94b2e41dba69f93f5644f7416', 'request_id': 'req-1ef2d58e-00ec-4aa8-bccd-96318bc82824'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:51.827472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] The token cache is being invalidate because project dc7084a94b2e41dba69f93f5644f7416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:51.827781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:51.828522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:51.830355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1176/2351] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:51 2022] DELETE /identity/v3/projects/dc7084a94b2e41dba69f93f5644f7416 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:51.834465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:51.847529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087db285-f20f-44e3-b487-4dc2c6e8926c service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:51.947408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:51.948347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:51.948630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:51.948901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] PATH_INFO: `/v3/users/7327cd0fda004e278c1c815c08d0cff2` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:51.950130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7327cd0fda004e278c1c815c08d0cff2)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:51.952132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:52.227328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7327cd0fda004e278c1c815c08d0cff2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:52.234525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7327cd0fda004e278c1c815c08d0cff2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:52.235371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7327cd0fda004e278c1c815c08d0cff2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:52.236050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7327cd0fda004e278c1c815c08d0cff2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:52.250022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7327cd0fda004e278c1c815c08d0cff2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:52.343827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1176/2352] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:51 2022] DELETE /identity/v3/users/7327cd0fda004e278c1c815c08d0cff2 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:52.510552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:52.512116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:52.574671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d58e-00ec-4aa8-bccd-96318bc82824 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:52.630076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:52.630745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:52.631031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:52.631356 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:52.633299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:52.705527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:52.707018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:52.718687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1177/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:52.871568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:52.872493 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:52.947656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf77bcf-7abf-4df1-957f-5266df3a284e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:52.954260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:52.955515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:52.955515 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:52.957262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] PATH_INFO: `/v3/projects/5fd70fdcfd2745468974f91c0654aefd` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:52.958872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd70fdcfd2745468974f91c0654aefd)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:52.961074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:53.189642 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd70fdcfd2745468974f91c0654aefd', 'request_id': 'req-a5c308d2-9433-48c1-8760-3dcef25f4071'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.196645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd70fdcfd2745468974f91c0654aefd', 'request_id': 'req-a5c308d2-9433-48c1-8760-3dcef25f4071'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.203766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd70fdcfd2745468974f91c0654aefd', 'request_id': 'req-a5c308d2-9433-48c1-8760-3dcef25f4071'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.310768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] The token cache is being invalidate because project 5fd70fdcfd2745468974f91c0654aefd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:53.311070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.312099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.314544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1177/2354] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:52 2022] DELETE /identity/v3/projects/5fd70fdcfd2745468974f91c0654aefd => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:53.318567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:53.329140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d756bb-105a-45bd-8afa-d9c95bfbc961 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:53.388921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:53.389900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:53.390250 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:53.390621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] PATH_INFO: `/v3/users/c00701435bff431a9c01dc4d2ce3b4f4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:53.395303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00701435bff431a9c01dc4d2ce3b4f4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:53.395303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:53.569798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00701435bff431a9c01dc4d2ce3b4f4'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.583222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00701435bff431a9c01dc4d2ce3b4f4'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.584243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00701435bff431a9c01dc4d2ce3b4f4'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.585158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00701435bff431a9c01dc4d2ce3b4f4'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.669384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82486517-72f5-4b7f-8544-cd6c191303d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00701435bff431a9c01dc4d2ce3b4f4'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:53.683606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1178/2355] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:53 2022] DELETE /identity/v3/users/c00701435bff431a9c01dc4d2ce3b4f4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:54.254761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:54.255501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:54.285177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c308d2-9433-48c1-8760-3dcef25f4071 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:54.401777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:54.402791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:54.403266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:54.404248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] PATH_INFO: `/v3/projects/4c871e8fa3624d42b96d46b309e58147` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:54.405628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c871e8fa3624d42b96d46b309e58147)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:54.410556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:54.546014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c871e8fa3624d42b96d46b309e58147', 'request_id': 'req-bf6a7e86-a5de-47f5-91fd-36074b9557cc'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:54.550092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c871e8fa3624d42b96d46b309e58147', 'request_id': 'req-bf6a7e86-a5de-47f5-91fd-36074b9557cc'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:54.556429 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c871e8fa3624d42b96d46b309e58147', 'request_id': 'req-bf6a7e86-a5de-47f5-91fd-36074b9557cc'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:54.662977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] The token cache is being invalidate because project 4c871e8fa3624d42b96d46b309e58147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:30:54.663349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:54.663968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-bf6a7e86-a5de-47f5-91fd-36074b9557cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:30:54.665633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1178/2356] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:30:54 2022] DELETE /identity/v3/projects/4c871e8fa3624d42b96d46b309e58147 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:54.670695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:54.671219 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:54.671358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:54.696369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:54.700908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:54.767294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1179/2357] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:54.772931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:54.773228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:54.773513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:54.793919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:54.795442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:54.803503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1179/2358] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:54.807993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:54.818714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b09b81-6baf-4481-892c-be5d6cc73de7 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:54.823773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:54.824441 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:54.824855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:54.825702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:54.826548 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:30:54.826863 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:54.828516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:54.844034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1180/2359] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:30:54.851314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:54.861172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8fa89-7249-441c-b666-a6ed5f7f7e06 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:54.866092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:54.866754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:54.867044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:54.867430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:54.872894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:54.872894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:54.974074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1180/2360] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:30:54 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:30:54.978354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:54.988843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc950c8-7346-4e9a-9fc1-bdeb48011eed admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:55.060362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:55.063607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:55.064162 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:55.064949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:55.066950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:55.073163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:55.171772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1181/2361] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:30:54 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:30:55.185094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:55.202374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3a297-da75-48fa-961c-db96d9c56352 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:55.207830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:55.208572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:55.208880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:55.209149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:55.209852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:55.211582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:55.228737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1181/2362] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:55.235960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:55.248143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929c826-36af-44a1-8929-ae6d5c559a29 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:55.253822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80228-fcd8-44a8-b5af-ab48d14ac64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:55.254571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80228-fcd8-44a8-b5af-ab48d14ac64c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:55.254817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80228-fcd8-44a8-b5af-ab48d14ac64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:55.255086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80228-fcd8-44a8-b5af-ab48d14ac64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:55.255843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80228-fcd8-44a8-b5af-ab48d14ac64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:55.257631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80228-fcd8-44a8-b5af-ab48d14ac64c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:55.271288 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1182/2363] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:30:55.275283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:55.292826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0e1dd-568d-4882-8d65-9d40d988f373 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:55.300836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:55.301756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:55.302038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:55.302318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] PATH_INFO: `/v3/projects/22fa5475930145b8a4db134c5219c787/users/eef71380f9674c4ba3e9f4c38919621d/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:55.323976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fa5475930145b8a4db134c5219c787, user_id=eef71380f9674c4ba3e9f4c38919621d, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:55.327597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:55.652957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1182/2364] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:30:55 2022] PUT /identity/v3/projects/22fa5475930145b8a4db134c5219c787/users/eef71380f9674c4ba3e9f4c38919621d/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:30:55.663387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:55.663674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:55.663955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:55.691832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] MFA Rules not processed for user `eef71380f9674c4ba3e9f4c38919621d`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:30:55.693031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:55.761249 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1183/2365] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:30:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:30:55.772605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:55.774814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:55.865673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b4c7f-da21-4a1b-8c16-bb933647effa admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:55.874056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d679b6-ee51-49bf-b2b6-46fd8eba6513 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:55.874056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d679b6-ee51-49bf-b2b6-46fd8eba6513 service glance] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:55.874056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d679b6-ee51-49bf-b2b6-46fd8eba6513 service glance] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:55.874056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d679b6-ee51-49bf-b2b6-46fd8eba6513 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:55.879658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d679b6-ee51-49bf-b2b6-46fd8eba6513 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:55.881114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d679b6-ee51-49bf-b2b6-46fd8eba6513 service glance] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:30:55.890637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1183/2366] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:30:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:30:59.805229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:30:59.806662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:30:59.880540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca64511-e187-4e24-9ae2-5c21ffa73c49 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:30:59.886160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:30:59.887119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:30:59.887542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:30:59.887756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] PATH_INFO: `/v3/users/17f414f8e6224ad3be85aa5a10fc3b3e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:30:59.889430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f414f8e6224ad3be85aa5a10fc3b3e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:30:59.891490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:00.080722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f414f8e6224ad3be85aa5a10fc3b3e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:00.093627 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f414f8e6224ad3be85aa5a10fc3b3e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:00.094317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f414f8e6224ad3be85aa5a10fc3b3e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:00.094930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f414f8e6224ad3be85aa5a10fc3b3e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:00.193186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f414f8e6224ad3be85aa5a10fc3b3e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:00.207030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1184/2367] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:30:59 2022] DELETE /identity/v3/users/17f414f8e6224ad3be85aa5a10fc3b3e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:00.211653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:00.212172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:00.212469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:00.232936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:00.234386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:00.300030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1184/2368] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:31:00.311326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:00.313666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:00.376967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8bd3-9fbc-456c-a580-1a2369b861ef admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:00.380781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:00.381428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:00.381707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:00.381984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:00.391943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:00.393996 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:00.405605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1185/2369] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:31:00.865739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:00.867332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:00.890001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42686e11-24fa-41c1-95b1-1bad927343cf None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:00.906926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:00.907924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:00.908211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:00.908543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] PATH_INFO: `/v3/projects/0d10da3e2e984480b06841352f1f3246` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:00.911869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d10da3e2e984480b06841352f1f3246)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:00.914523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:01.037039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d10da3e2e984480b06841352f1f3246', 'request_id': 'req-96024f6c-33e2-4842-8649-9ab6010c91e8'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.042406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d10da3e2e984480b06841352f1f3246', 'request_id': 'req-96024f6c-33e2-4842-8649-9ab6010c91e8'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.050051 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d10da3e2e984480b06841352f1f3246', 'request_id': 'req-96024f6c-33e2-4842-8649-9ab6010c91e8'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.172500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] The token cache is being invalidate because project 0d10da3e2e984480b06841352f1f3246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:31:01.172824 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.173462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.175372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1185/2370] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:31:00 2022] DELETE /identity/v3/projects/0d10da3e2e984480b06841352f1f3246 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:01.179194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:01.190668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239448f-73d4-4e80-a8ee-ce7acc1b889e service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:01.253265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:01.254135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:01.254419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:01.254693 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] PATH_INFO: `/v3/users/1edfaea696df46f4b6e19a0d0217bd65` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:01.256214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edfaea696df46f4b6e19a0d0217bd65)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:01.258355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:01.518646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edfaea696df46f4b6e19a0d0217bd65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.535851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edfaea696df46f4b6e19a0d0217bd65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.538821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edfaea696df46f4b6e19a0d0217bd65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.538821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edfaea696df46f4b6e19a0d0217bd65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.639452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edfaea696df46f4b6e19a0d0217bd65'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:01.654276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1186/2371] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:31:01 2022] DELETE /identity/v3/users/1edfaea696df46f4b6e19a0d0217bd65 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:02.100309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:02.101827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:02.115524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96024f6c-33e2-4842-8649-9ab6010c91e8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:02.173290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:02.174092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:02.174512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:02.174636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] PATH_INFO: `/v3/projects/4c880ca880e341059f13db99244aa386` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:02.175884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c880ca880e341059f13db99244aa386)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:02.177828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:02.291880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c880ca880e341059f13db99244aa386', 'request_id': 'req-fd39b693-e2f3-4e9d-8942-c5b4d238224b'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.298193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c880ca880e341059f13db99244aa386', 'request_id': 'req-fd39b693-e2f3-4e9d-8942-c5b4d238224b'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.304431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c880ca880e341059f13db99244aa386', 'request_id': 'req-fd39b693-e2f3-4e9d-8942-c5b4d238224b'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.377871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] The token cache is being invalidate because project 4c880ca880e341059f13db99244aa386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:31:02.378162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.378800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.380364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1186/2372] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:31:02 2022] DELETE /identity/v3/projects/4c880ca880e341059f13db99244aa386 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:02.384265 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:02.385707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:02.400020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9615e21-53a3-4741-bcc6-7828797e13a3 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:02.458043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:02.458691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:02.458973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:02.459267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] PATH_INFO: `/v3/users/d521868b4e334e3fbd33a9d63ab3e1ba` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:02.460494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d521868b4e334e3fbd33a9d63ab3e1ba)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:02.462447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:02.658636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd521868b4e334e3fbd33a9d63ab3e1ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.670489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd521868b4e334e3fbd33a9d63ab3e1ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.671156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd521868b4e334e3fbd33a9d63ab3e1ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.671787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd521868b4e334e3fbd33a9d63ab3e1ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.743163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-83840d89-e2eb-42d1-bf90-61ee8a28e3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd521868b4e334e3fbd33a9d63ab3e1ba'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:02.757992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1187/2373] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:31:02 2022] DELETE /identity/v3/users/d521868b4e334e3fbd33a9d63ab3e1ba => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:03.145900 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:03.147373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:03.160392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39b693-e2f3-4e9d-8942-c5b4d238224b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:03.217639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:03.218497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.218776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.219062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] PATH_INFO: `/v3/projects/0da77d65f5ef4f44b184a7f3e0efbec8` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.220240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da77d65f5ef4f44b184a7f3e0efbec8)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:03.222255 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:03.345170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da77d65f5ef4f44b184a7f3e0efbec8', 'request_id': 'req-96bfd3bb-604b-4896-b6ad-18859b723434'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:03.350454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da77d65f5ef4f44b184a7f3e0efbec8', 'request_id': 'req-96bfd3bb-604b-4896-b6ad-18859b723434'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:03.357145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da77d65f5ef4f44b184a7f3e0efbec8', 'request_id': 'req-96bfd3bb-604b-4896-b6ad-18859b723434'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:03.411275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] The token cache is being invalidate because project 0da77d65f5ef4f44b184a7f3e0efbec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:31:03.411590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:03.412161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-96bfd3bb-604b-4896-b6ad-18859b723434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:03.413721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1187/2374] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:31:03 2022] DELETE /identity/v3/projects/0da77d65f5ef4f44b184a7f3e0efbec8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:03.419453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.423997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.423997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.438331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:03.439631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:03.500738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1188/2375] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:03.565177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.565463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.565742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.584183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:03.585442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:03.593929 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1188/2376] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:03.598259 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:03.608975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b60305-6cbc-479d-9c6b-40e92cbf84de None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:03.613762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:03.614420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.614696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.614967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.615719 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:31:03.616031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:03.617651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:03.630453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1189/2377] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:31:03.634758 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:03.644444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5055c65-fb9b-401c-a120-07d8c9369521 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:03.652858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:03.653808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.654090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.654363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.655052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:03.656998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:03.783972 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1189/2378] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:31:03 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:31:03.788096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:03.799034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8330-46a5-436f-adb7-6b455b113e95 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:03.854674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:03.855272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.855560 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.855830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.856721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:03.858635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:03.959428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1190/2379] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:31:03 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:31:03.963457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:03.973875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba80b4c-51a3-42a2-9311-33d7dd218651 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:03.978630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:03.979332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:03.979616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:03.979896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:03.980624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:03.982225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:03.994028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1190/2380] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:31:03.998447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:04.008287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2971d-2510-4c52-b555-55b924d72277 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:04.014175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffcabe-cbb6-4f4e-bc32-ce6946aa06d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:04.014807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffcabe-cbb6-4f4e-bc32-ce6946aa06d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:04.015093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffcabe-cbb6-4f4e-bc32-ce6946aa06d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:04.015412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffcabe-cbb6-4f4e-bc32-ce6946aa06d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:04.016139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffcabe-cbb6-4f4e-bc32-ce6946aa06d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:04.017737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffcabe-cbb6-4f4e-bc32-ce6946aa06d9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:04.027781 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1191/2381] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:31:04.032103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:04.041844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad60156-7d0f-4758-b22a-1eab43883bf8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:04.046783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:04.047705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:04.047990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:04.048268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] PATH_INFO: `/v3/projects/0866e0526e8342e485bb8714c59ed834/users/a0704dbb1f7e4d0f8a1c80eeea0b770c/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:04.063532 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0866e0526e8342e485bb8714c59ed834, user_id=a0704dbb1f7e4d0f8a1c80eeea0b770c, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:04.066316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:04.166910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1191/2382] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:31:04 2022] PUT /identity/v3/projects/0866e0526e8342e485bb8714c59ed834/users/a0704dbb1f7e4d0f8a1c80eeea0b770c/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:04.180016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f80a9-f925-403e-a0cb-23a2d30b56a4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:04.180308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f80a9-f925-403e-a0cb-23a2d30b56a4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:04.180609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f80a9-f925-403e-a0cb-23a2d30b56a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:04.198893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a95f80a9-f925-403e-a0cb-23a2d30b56a4 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:04.200160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a95f80a9-f925-403e-a0cb-23a2d30b56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:04.265311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1192/2383] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:31:04.275042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:04.276783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:04.333807 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40576-3ffe-45f0-831d-d2bae07bf2cd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:04.337592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a919bbd-fdc3-4e20-b353-5f1a675f7588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:04.338248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a919bbd-fdc3-4e20-b353-5f1a675f7588 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:04.338539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a919bbd-fdc3-4e20-b353-5f1a675f7588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:04.338821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a919bbd-fdc3-4e20-b353-5f1a675f7588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:04.348720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a919bbd-fdc3-4e20-b353-5f1a675f7588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:04.350149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a919bbd-fdc3-4e20-b353-5f1a675f7588 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:04.360084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1192/2384] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:31:08.966100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:08.966625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:08.966725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:08.985074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] MFA Rules not processed for user `fe4733f5e72d4a3ab627a4fd80ee76e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:08.986280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:09.040789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1193/2385] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:10.300282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:10.300696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:10.300835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:10.337911 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] MFA Rules not processed for user `a0704dbb1f7e4d0f8a1c80eeea0b770c`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:10.339410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:10.448677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1193/2386] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:10.449604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:10.461125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d54a25-a38e-4329-bc33-ad7676c8aa2e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:10.468712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:10.469489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:10.469845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:10.470213 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:10.470988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:10.473086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:10.578974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1194/2387] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:31:10 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:31:10.603974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:10.615591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808bca-4bd9-40d4-9189-7d1c74f7f638 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:10.673034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:10.673802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:10.674087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:10.674364 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:10.675149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:10.677104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:10.853228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1194/2388] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:31:10 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:31:10.854667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:10.866326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55407326-47b4-40db-ba8b-73b0766a5a1e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:10.870845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:10.871680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:10.872135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:10.872422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:10.873276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:10.874874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:10.885696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1195/2389] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:31:10.890744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:10.910112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b4c3-3a73-4933-a092-0666a9cf806c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:10.914806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:10.918074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:10.918074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:10.918074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] PATH_INFO: `/v3/projects/aa63334d788a4e798eff8ba08d4d71e7/users/0944a8fd232244f9bbf64fd205bb9182/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:10.933832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa63334d788a4e798eff8ba08d4d71e7, user_id=0944a8fd232244f9bbf64fd205bb9182, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:10.937037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:11.058319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1195/2390] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:31:10 2022] PUT /identity/v3/projects/aa63334d788a4e798eff8ba08d4d71e7/users/0944a8fd232244f9bbf64fd205bb9182/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:11.062164 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:11.074631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff15832-ea45-4849-bf3e-534c7313542b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:11.142256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:11.142830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:11.143202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:11.143426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:11.144175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:11.145827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:11.156622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1196/2391] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:31:11.160915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:11.173105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2aa3f-7350-4461-adc1-9f75e6c66494 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:11.178331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ff92-5595-4db7-8c7c-5d9d98cc5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:11.179780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ff92-5595-4db7-8c7c-5d9d98cc5197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:11.185584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ff92-5595-4db7-8c7c-5d9d98cc5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:11.185584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ff92-5595-4db7-8c7c-5d9d98cc5197 admin admin] PATH_INFO: `/v3/projects/aa63334d788a4e798eff8ba08d4d71e7/users/0944a8fd232244f9bbf64fd205bb9182/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:11.185584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ff92-5595-4db7-8c7c-5d9d98cc5197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa63334d788a4e798eff8ba08d4d71e7, user_id=0944a8fd232244f9bbf64fd205bb9182, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:11.186041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ff92-5595-4db7-8c7c-5d9d98cc5197 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:11.197491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1196/2392] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:31:11 2022] PUT /identity/v3/projects/aa63334d788a4e798eff8ba08d4d71e7/users/0944a8fd232244f9bbf64fd205bb9182/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:11.995527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:11.998913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:12.117705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4928ab-79b6-4a1c-8691-a626412c389d admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:12.181860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:12.182507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:12.182789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:12.183060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:12.185022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:12.196507 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:12.198079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:12.208805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1197/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:31:18.258890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555830f8-a318-44e4-9fd8-3c70e74a2628 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:18.259458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555830f8-a318-44e4-9fd8-3c70e74a2628 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:18.259458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555830f8-a318-44e4-9fd8-3c70e74a2628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:18.290693 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-555830f8-a318-44e4-9fd8-3c70e74a2628 None None] MFA Rules not processed for user `0944a8fd232244f9bbf64fd205bb9182`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:18.292118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-555830f8-a318-44e4-9fd8-3c70e74a2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:18.375631 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1197/2394] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:18.387654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:18.389142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:18.449217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866764-4729-45dd-9961-f710693440d4 service placement] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:18.453196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:18.453847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:18.454129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:18.454403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:18.516315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:18.517766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:18.527792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1198/2395] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:31:18.783128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:18.783444 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:18.783722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:18.839548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:18.841495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:18.911356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1198/2396] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:19.055459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:19.059105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:19.149528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e277f0-1457-420a-b3a5-0f7af35c0573 service glance] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:19.155494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12baefb-dc24-4f84-a969-04bf9320e7de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:19.156144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12baefb-dc24-4f84-a969-04bf9320e7de service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:19.156429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12baefb-dc24-4f84-a969-04bf9320e7de service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:19.156706 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12baefb-dc24-4f84-a969-04bf9320e7de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:19.164966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12baefb-dc24-4f84-a969-04bf9320e7de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:19.166488 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12baefb-dc24-4f84-a969-04bf9320e7de service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:19.174728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1199/2397] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:31:27.113926 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:27.115394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:27.196339 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceac4e1-c3f7-4134-a438-e70697a07d40 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:27.201826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:27.202718 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:27.202995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:27.203284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] PATH_INFO: `/v3/users/1b52407210f9489fb1cceec2e4dfd696` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:27.204512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b52407210f9489fb1cceec2e4dfd696)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:27.206449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:27.402354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b52407210f9489fb1cceec2e4dfd696'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:27.409936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b52407210f9489fb1cceec2e4dfd696'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:27.410625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b52407210f9489fb1cceec2e4dfd696'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:27.411224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b52407210f9489fb1cceec2e4dfd696'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:27.426650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b52407210f9489fb1cceec2e4dfd696'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:27.504523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1199/2398] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:31:27 2022] DELETE /identity/v3/users/1b52407210f9489fb1cceec2e4dfd696 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:27.508579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:27.509110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:27.509367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:27.533227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:27.534447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:27.604674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1200/2399] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:27.615769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:27.617308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:27.696361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565eba5-504f-4f88-a3b6-56bb0aef0df0 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:27.702829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8beb6a-729d-4152-9953-a6f11c893768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:27.703689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8beb6a-729d-4152-9953-a6f11c893768 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:27.704046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8beb6a-729d-4152-9953-a6f11c893768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:27.704390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8beb6a-729d-4152-9953-a6f11c893768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:27.714800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8beb6a-729d-4152-9953-a6f11c893768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:27.716435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8beb6a-729d-4152-9953-a6f11c893768 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:27.744575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1200/2400] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:31:28.174722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:28.176764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:28.202085 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ddb02-12a9-4b76-a9f8-bfb4abb350ca None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:28.210048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:28.210926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:28.211389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:28.211652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] PATH_INFO: `/v3/projects/14d7f5ffaf3448bd89d166b51d0e02bf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:28.213009 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d7f5ffaf3448bd89d166b51d0e02bf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:28.215188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:28.328385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d7f5ffaf3448bd89d166b51d0e02bf', 'request_id': 'req-c576e3f2-2741-4e3f-8a40-d30a5e944c60'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:28.404697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d7f5ffaf3448bd89d166b51d0e02bf', 'request_id': 'req-c576e3f2-2741-4e3f-8a40-d30a5e944c60'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:28.411702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d7f5ffaf3448bd89d166b51d0e02bf', 'request_id': 'req-c576e3f2-2741-4e3f-8a40-d30a5e944c60'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:28.425612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] The token cache is being invalidate because project 14d7f5ffaf3448bd89d166b51d0e02bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:31:28.425987 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:28.427750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c576e3f2-2741-4e3f-8a40-d30a5e944c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:28.430130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1201/2401] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:31:28 2022] DELETE /identity/v3/projects/14d7f5ffaf3448bd89d166b51d0e02bf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:30.597270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f662b-404e-4283-bb17-80afe985acde None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:30.597817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f662b-404e-4283-bb17-80afe985acde None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:30.597817 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f662b-404e-4283-bb17-80afe985acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:30.615028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e39f662b-404e-4283-bb17-80afe985acde None None] MFA Rules not processed for user `a0704dbb1f7e4d0f8a1c80eeea0b770c`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:30.616314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e39f662b-404e-4283-bb17-80afe985acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:30.669560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1201/2402] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:34.339812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:34.340989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:34.343544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:34.367740 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:34.370268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:34.428809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1202/2403] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:34.441531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f662b-404e-4283-bb17-80afe985acde None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:34.443016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e39f662b-404e-4283-bb17-80afe985acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:34.522399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f662b-404e-4283-bb17-80afe985acde None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:34.526732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:34.527449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:34.527944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:34.528175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:34.537622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:34.539392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:34.553658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1202/2404] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:31:53.974553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:53.976033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:54.048687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591b1af-93db-4e43-b0bb-dbf15446f91c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:54.053429 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:54.054302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:54.054588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:54.054928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] PATH_INFO: `/v3/users/eef71380f9674c4ba3e9f4c38919621d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:54.056175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef71380f9674c4ba3e9f4c38919621d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:54.058204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:54.270584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef71380f9674c4ba3e9f4c38919621d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:54.285666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef71380f9674c4ba3e9f4c38919621d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:54.286361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef71380f9674c4ba3e9f4c38919621d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:54.286962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef71380f9674c4ba3e9f4c38919621d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:54.289197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:54.290724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:54.348452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b044784-46b5-4599-9b33-468d840dbedd service swift] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:54.352046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:54.356115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:54.356115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:54.356115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:54.357223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:54.365292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-62671e79-1309-4a3d-b471-59c2da0cf514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef71380f9674c4ba3e9f4c38919621d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:54.378353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1203/2405] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:31:53 2022] DELETE /identity/v3/users/eef71380f9674c4ba3e9f4c38919621d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:54.382656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:54.382949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:54.383232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:54.400298 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:54.401493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:54.421252 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:54.422687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:54.432282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1203/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:31:54.461358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1204/2407] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:31:54.472012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:54.473562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:54.484823 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16aea-e7ec-413a-886c-1330d440d3ba service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:54.533303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe1df-b126-4ab8-95d1-1e8f78e3d151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:54.533938 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe1df-b126-4ab8-95d1-1e8f78e3d151 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:54.534219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe1df-b126-4ab8-95d1-1e8f78e3d151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:54.534491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe1df-b126-4ab8-95d1-1e8f78e3d151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:54.543875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe1df-b126-4ab8-95d1-1e8f78e3d151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:54.545993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe1df-b126-4ab8-95d1-1e8f78e3d151 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:54.555576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1204/2408] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:31:55.204193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:55.205669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:55.218839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b6d3b-89a6-4f64-a202-4b0cefaf3477 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:55.223461 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:55.224309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.224593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.224871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] PATH_INFO: `/v3/projects/22fa5475930145b8a4db134c5219c787` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.226050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fa5475930145b8a4db134c5219c787)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:55.228004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:55.349409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fa5475930145b8a4db134c5219c787', 'request_id': 'req-1dda0499-4fb8-4c23-83b4-025dae668c51'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:55.434499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fa5475930145b8a4db134c5219c787', 'request_id': 'req-1dda0499-4fb8-4c23-83b4-025dae668c51'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:55.442873 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fa5475930145b8a4db134c5219c787', 'request_id': 'req-1dda0499-4fb8-4c23-83b4-025dae668c51'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:55.456663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] The token cache is being invalidate because project 22fa5475930145b8a4db134c5219c787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:31:55.456955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:55.457629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-1dda0499-4fb8-4c23-83b4-025dae668c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:31:55.463314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1205/2409] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:31:55 2022] DELETE /identity/v3/projects/22fa5475930145b8a4db134c5219c787 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:55.464301 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.464810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.464914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.485083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:55.486424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:55.550839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1205/2410] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:31:55.569045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.569354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.569629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.592891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:55.594576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:55.603161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1206/2411] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:55.607464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:55.617593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96dea8-cef9-44f9-8476-cce8b4a0d18c None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:55.622940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:55.624477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.625014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.625457 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.626592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:31:55.627831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:55.629869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:55.644677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1206/2412] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:31:55.648671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:55.659226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967e88f-bde6-4b1e-ab9b-194039ffcf73 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:55.665540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:55.668180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.668180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.668180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.668180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:55.669516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:55.761640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1207/2413] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:31:55 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:31:55.766877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:55.776834 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6c4b-1e50-44f7-b526-667b13a24a26 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:55.838867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:55.839680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.840286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.840286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.841119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:55.843436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:55.941072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1207/2414] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:31:55 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:31:55.942394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:55.953020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a0fc-0ff2-48b3-af48-d4f3438a4650 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:55.957724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:55.958526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.958813 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.959091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.959874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:55.961520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:55.972524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1208/2415] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:31:55.976605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:55.987590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158ea9a-4e32-4718-a523-43e29990bac9 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:55.992382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00086-cd3c-44af-b251-91b482b2c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:55.993283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00086-cd3c-44af-b251-91b482b2c815 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:55.993567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00086-cd3c-44af-b251-91b482b2c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:55.993843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00086-cd3c-44af-b251-91b482b2c815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:55.994597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f00086-cd3c-44af-b251-91b482b2c815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:55.996219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f00086-cd3c-44af-b251-91b482b2c815 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:56.008038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1208/2416] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:31:56.012403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:56.022363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e5cde-9df9-4b0b-aece-1fd558bb3fb4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:56.026960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:56.028010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:56.028111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:56.028380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] PATH_INFO: `/v3/projects/556aab5efc824184b9826b801b2166b5/users/ced18765b9da45b08473fcc351c36dbb/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:56.043199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=556aab5efc824184b9826b801b2166b5, user_id=ced18765b9da45b08473fcc351c36dbb, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:56.051315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:56.126564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1209/2417] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:31:56 2022] PUT /identity/v3/projects/556aab5efc824184b9826b801b2166b5/users/ced18765b9da45b08473fcc351c36dbb/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:31:56.128704 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:56.129003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:56.129338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:56.164852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] MFA Rules not processed for user `ced18765b9da45b08473fcc351c36dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:31:56.166091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:56.234880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1209/2418] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:31:56.245760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:31:56.247462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:31:56.303974 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b659d-071b-497b-8bae-b69adcce10ad admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:31:56.307728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12f04-10be-491b-97cc-d47775473309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:31:56.308367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12f04-10be-491b-97cc-d47775473309 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:31:56.308647 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12f04-10be-491b-97cc-d47775473309 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:31:56.308916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12f04-10be-491b-97cc-d47775473309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:31:56.317965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12f04-10be-491b-97cc-d47775473309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:31:56.319574 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12f04-10be-491b-97cc-d47775473309 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:31:56.329205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1210/2419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:32:09.800203 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:32:09.861459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733f66f-09df-40a4-b9d4-c4e53ef05316 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:32:09.866020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:32:09.866884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:09.867171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:09.867479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] PATH_INFO: `/v3/users/ced18765b9da45b08473fcc351c36dbb` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:09.868666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced18765b9da45b08473fcc351c36dbb)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:32:09.870579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:32:10.115114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced18765b9da45b08473fcc351c36dbb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:10.121829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced18765b9da45b08473fcc351c36dbb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:10.122488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced18765b9da45b08473fcc351c36dbb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:10.123096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced18765b9da45b08473fcc351c36dbb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:10.135008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced18765b9da45b08473fcc351c36dbb'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:10.227181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1210/2420] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:32:09 2022] DELETE /identity/v3/users/ced18765b9da45b08473fcc351c36dbb => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:32:10.231630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3046f-d729-45f0-a230-59faa042059a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:10.232124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3046f-d729-45f0-a230-59faa042059a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:10.232222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3046f-d729-45f0-a230-59faa042059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:10.249188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-edb3046f-d729-45f0-a230-59faa042059a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:32:10.251101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-edb3046f-d729-45f0-a230-59faa042059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:10.306750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1211/2421] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:32:10.317084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:32:10.318502 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:10.375422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe98df3-12e5-486c-9dff-2cfb1ace32e6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:32:10.378915 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:32:10.379592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:10.379870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:10.380148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:10.389421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:32:10.391036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:32:10.400674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1211/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:32:11.308374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3046f-d729-45f0-a230-59faa042059a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:32:11.309897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-edb3046f-d729-45f0-a230-59faa042059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:11.327421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3046f-d729-45f0-a230-59faa042059a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:32:11.332456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:32:11.333333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:11.333766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:11.334038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] PATH_INFO: `/v3/projects/556aab5efc824184b9826b801b2166b5` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:11.335784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=556aab5efc824184b9826b801b2166b5)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:32:11.337747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:32:11.714575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556aab5efc824184b9826b801b2166b5', 'request_id': 'req-c5cf3edb-f325-4828-bc68-9517eb8f55ff'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:11.816519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556aab5efc824184b9826b801b2166b5', 'request_id': 'req-c5cf3edb-f325-4828-bc68-9517eb8f55ff'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:11.822399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556aab5efc824184b9826b801b2166b5', 'request_id': 'req-c5cf3edb-f325-4828-bc68-9517eb8f55ff'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:11.834272 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] The token cache is being invalidate because project 556aab5efc824184b9826b801b2166b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:32:11.834685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:11.835366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-c5cf3edb-f325-4828-bc68-9517eb8f55ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:32:11.837155 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1212/2423] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:32:11 2022] DELETE /identity/v3/projects/556aab5efc824184b9826b801b2166b5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:32:17.587837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:32:17.589296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:17.601165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55016d5-ed9c-4748-99f4-9cd6502e395a service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:32:17.648963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:32:17.649604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:17.649886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:17.650161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:17.651945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:17.713418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:32:17.714836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:32:17.726602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1212/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:32:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:32:56.546665 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:56.547450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:56.547555 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:56.570102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:32:56.570102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:56.649618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1213/2425] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:32:56.694521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:32:56.696002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:32:56.769856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e930-c32f-47e9-8470-a0d93d8868cf service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:32:56.772675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:32:56.773316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:32:56.773597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:32:56.773871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:32:56.781933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:32:56.783755 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:32:56.792000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1213/2426] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:32:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:33:06.086456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:06.087932 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:06.099324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989f6c-aebf-47d0-8e5c-484718590183 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:06.102917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:06.103562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:06.103890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:06.104100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:06.105811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:06.195282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:06.196712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f23568-d73c-4bbf-b2a4-66a92248b382 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:06.218403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1214/2427] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:06.607000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:06.618327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f399ebe-e1f1-4328-949c-0ea71a28a3d1 service swift] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:06.622976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:06.623713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:06.623981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:06.624723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:06.626738 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:06.642352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:06.644012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:06.656473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1214/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:13.862709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:13.863362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:13.863362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:13.880410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] MFA Rules not processed for user `b6e168c909c64a48bcc2762081ed0658`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:33:13.881583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:13.936098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1215/2429] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:33:16.744209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:16.745533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:16.759186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b737-19ef-4aea-8215-5ecc38d555d6 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:16.764742 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:16.765369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:16.765652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:16.765928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:16.768243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:16.778554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:16.780167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8085082-c8e5-4c0e-b4b6-bfccca2e6943 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:16.791752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1215/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:17.348543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:17.357949 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37badd-fae4-4eab-a353-3b468ae305af None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:17.362260 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:17.362883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:17.363159 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:17.363471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:17.365274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:17.374552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:17.376029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ee04-bc95-4a38-974a-a06b38b1054e service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:17.384065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1216/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:17.676230 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf67ba-4e70-4080-b8bd-5cff8c38228a None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:17.676523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf67ba-4e70-4080-b8bd-5cff8c38228a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:17.676811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf67ba-4e70-4080-b8bd-5cff8c38228a None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:17.678283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1216/2432] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:33:17.684915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786235f-14ee-4028-8b97-32599c062a4e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:17.685210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786235f-14ee-4028-8b97-32599c062a4e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:17.685492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786235f-14ee-4028-8b97-32599c062a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:17.723339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0786235f-14ee-4028-8b97-32599c062a4e None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:33:17.724544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0786235f-14ee-4028-8b97-32599c062a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:17.735147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1217/2433] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:33:17.750024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf67ba-4e70-4080-b8bd-5cff8c38228a None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:17.752462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-37cf67ba-4e70-4080-b8bd-5cff8c38228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:17.809194 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf67ba-4e70-4080-b8bd-5cff8c38228a None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:17.812712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1faa29f-eb13-4140-89dd-b215a7485405 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:17.813348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa29f-eb13-4140-89dd-b215a7485405 service glance] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:17.813633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa29f-eb13-4140-89dd-b215a7485405 service glance] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:17.813923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1faa29f-eb13-4140-89dd-b215a7485405 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:17.825184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa29f-eb13-4140-89dd-b215a7485405 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:17.826691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1faa29f-eb13-4140-89dd-b215a7485405 service glance] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:17.837846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1217/2434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:18.052983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409878-f417-4fa1-8791-8aa73b766ee8 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.053273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409878-f417-4fa1-8791-8aa73b766ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.053567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409878-f417-4fa1-8791-8aa73b766ee8 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.054926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1218/2435] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 16:33:18.060575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296648-0076-4735-aecb-572b26eceef3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.060575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296648-0076-4735-aecb-572b26eceef3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.060575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296648-0076-4735-aecb-572b26eceef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.079094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-75296648-0076-4735-aecb-572b26eceef3 None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:33:18.080512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-75296648-0076-4735-aecb-572b26eceef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:18.086980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1218/2436] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:33:18.100206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409878-f417-4fa1-8791-8aa73b766ee8 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:18.101856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-12409878-f417-4fa1-8791-8aa73b766ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:18.116788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409878-f417-4fa1-8791-8aa73b766ee8 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:18.120571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ece3c-e8ff-4934-b2b4-d1b1a8648459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:18.121217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ece3c-e8ff-4934-b2b4-d1b1a8648459 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.121497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ece3c-e8ff-4934-b2b4-d1b1a8648459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.121768 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ece3c-e8ff-4934-b2b4-d1b1a8648459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.129800 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ece3c-e8ff-4934-b2b4-d1b1a8648459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:18.131300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ece3c-e8ff-4934-b2b4-d1b1a8648459 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:18.139481 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1219/2437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:18.224380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5e62-57ab-491c-9e65-49a2fdd2f5b6 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.224674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5e62-57ab-491c-9e65-49a2fdd2f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.224982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5e62-57ab-491c-9e65-49a2fdd2f5b6 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.226657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1219/2438] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:33:18.232846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.233138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.233416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.253822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:33:18.255019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:18.265199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1220/2439] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:33:18.276233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5e62-57ab-491c-9e65-49a2fdd2f5b6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:18.288242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5e62-57ab-491c-9e65-49a2fdd2f5b6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:18.291790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fca86c-a0c2-4716-b71b-b139f914cd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:18.292410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fca86c-a0c2-4716-b71b-b139f914cd48 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.292688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fca86c-a0c2-4716-b71b-b139f914cd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.292959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fca86c-a0c2-4716-b71b-b139f914cd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.303474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fca86c-a0c2-4716-b71b-b139f914cd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:18.304916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fca86c-a0c2-4716-b71b-b139f914cd48 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:18.315997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1220/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:18.379198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:18.380615 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:18.447824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc561-f0e5-4227-979a-830d54ff4cc9 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:18.452866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:18.453498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:18.453779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:18.454052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:18.455894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:18.468156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:18.469722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:18.480819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1221/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:22.253286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:22.254239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:22.254239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:22.271759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:33:22.278174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:22.280034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1221/2442] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:33:22.292504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:22.304702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b915c0-0edc-4c42-bb6e-cdb022b65ff4 service placement] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:22.310257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:22.310609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:22.310913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:22.311183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:22.321977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:22.323678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:22.332666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1222/2443] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:33:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:33:36.108328 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:36.118442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6db09-8186-47e6-b519-6a5aaa5340d1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:36.121980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:36.122599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:36.122879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:36.123180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:36.124953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:36.134277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:36.135729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f5c55-8bb5-4ad7-a0ea-f134725c75b0 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:36.143503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1222/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:42.184282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:42.185747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:42.201283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130336fc-8ac6-428a-9ecc-34c343e82549 service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:42.207412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:42.208039 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:42.208315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:42.208586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:42.210285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:42.266188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:42.267723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:42.277382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1223/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:33:49.403835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:49.404293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:49.404401 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:49.421752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:33:49.424746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:33:49.430154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1223/2446] 10.222.0.42 () {58 vars in 967 bytes} [Tue May 3 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:33:49.443508 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:33:49.454992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf297-460b-4d61-800a-17604eb64114 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:33:49.461283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:33:49.461934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:33:49.462242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:33:49.462517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:33:49.472099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:33:49.473110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:33:49.481346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1224/2447] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:34:27.789137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:27.808706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8b930-dc26-4c6e-8c6f-639d4a30a3d5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:27.821182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:27.823986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:27.823986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:27.823986 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:27.828623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:27.848406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:27.872871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:27.874709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2218dc-10cc-4f27-a9bb-3b539e396696 service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:27.874963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050dea-4850-41ec-b69e-355464161d65 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:27.881635 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:27.882315 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:27.882807 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:27.884296 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:27.886899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1224/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:34:27.888618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:27.905022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:27.906940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:27.920256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1225/2449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:34:29.666102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:29.666650 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:29.666763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:29.684470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] MFA Rules not processed for user `fe4733f5e72d4a3ab627a4fd80ee76e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:34:29.685657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:29.752490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1225/2450] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:34:30.114128 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:30.124077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb5c12-55bb-47a4-91f6-7ba224c9fca0 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:30.128160 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:30.128989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:30.129311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:30.129550 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:30.131992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:30.144417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:30.148361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:30.159710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1226/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:34:42.976131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:42.985518 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e934-0acd-4299-baea-0d44cfbfc8c7 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:42.989869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:42.990502 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:42.990787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:42.991066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:42.992869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:43.054828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:43.056274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:43.066588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1226/2452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:34:47.156575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:47.158674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:47.175917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a24a16-8abd-48a6-90c8-df6d30a9b555 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:47.180589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:47.181456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:47.181914 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:47.182184 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] PATH_INFO: `/v3/users/b6e168c909c64a48bcc2762081ed0658` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:47.183538 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e168c909c64a48bcc2762081ed0658)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:47.185439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:47.369129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e168c909c64a48bcc2762081ed0658'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.381118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e168c909c64a48bcc2762081ed0658'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.381918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e168c909c64a48bcc2762081ed0658'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.382502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e168c909c64a48bcc2762081ed0658'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.440861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-82016863-74e6-4caf-b013-1647ddf441d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e168c909c64a48bcc2762081ed0658'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.452708 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1227/2453] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:34:47 2022] DELETE /identity/v3/users/b6e168c909c64a48bcc2762081ed0658 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:34:47.685086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:47.696922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d979-6368-4f66-a9d3-551d93bda186 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:47.754046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:47.754901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:47.755181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:47.755485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] PATH_INFO: `/v3/projects/394ead9152f741e68d0eac3d52df3bc1` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:47.756639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394ead9152f741e68d0eac3d52df3bc1)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:47.758522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:47.861369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394ead9152f741e68d0eac3d52df3bc1', 'request_id': 'req-c474728e-384c-492d-8733-82f6248bc632'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.866928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394ead9152f741e68d0eac3d52df3bc1', 'request_id': 'req-c474728e-384c-492d-8733-82f6248bc632'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.873049 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394ead9152f741e68d0eac3d52df3bc1', 'request_id': 'req-c474728e-384c-492d-8733-82f6248bc632'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.966392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] The token cache is being invalidate because project 394ead9152f741e68d0eac3d52df3bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:34:47.966609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.967270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c474728e-384c-492d-8733-82f6248bc632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:47.968830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1227/2454] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:34:47 2022] DELETE /identity/v3/projects/394ead9152f741e68d0eac3d52df3bc1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:34:47.974439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:47.974761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:47.975075 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:47.993165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:34:47.994611 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:48.058332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1228/2455] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:34:48.066312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458421c-0357-40f2-90a1-22d638548110 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.066604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458421c-0357-40f2-90a1-22d638548110 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.066904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458421c-0357-40f2-90a1-22d638548110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.086979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-2458421c-0357-40f2-90a1-22d638548110 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:34:48.088272 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2458421c-0357-40f2-90a1-22d638548110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:48.097748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1228/2456] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:34:48.101582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.111725 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c72b4-6614-49d8-9d49-fc41a7448b99 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.116273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.116926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.117206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.117478 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.119438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:34:48.119789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.121327 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.133653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1229/2457] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:34:48.138082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458421c-0357-40f2-90a1-22d638548110 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.148246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458421c-0357-40f2-90a1-22d638548110 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.153409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.154182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.154464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.154740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.155455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.158681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.282476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1229/2458] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:34:48 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:34:48.284748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.294527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeb1b0-292d-4494-a6b9-50956c8758ab admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.359500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.360257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.360613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.361305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.362177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.364230 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.439406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1230/2459] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:34:48 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:34:48.443756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.457450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f68f9-f0a2-4409-b6a7-3b3051ae270b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.462490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.463237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.463544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.464217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.465068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.466719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.478640 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1230/2460] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:34:48.482927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.493798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc6322-0ed0-4458-80db-c5eb69b0eb2c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.498458 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9123e-093e-4746-a4fe-249e155063c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.499149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9123e-093e-4746-a4fe-249e155063c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.499522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9123e-093e-4746-a4fe-249e155063c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.499789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9123e-093e-4746-a4fe-249e155063c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.500512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9123e-093e-4746-a4fe-249e155063c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.502901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9123e-093e-4746-a4fe-249e155063c6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.513713 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1231/2461] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:34:48.523366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.533271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a325-2b15-40cf-bae3-ca37fb803cb2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.537910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.538777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.539059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.539367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] PATH_INFO: `/v3/projects/48da99959ab5440fa000890eeb7cfd11/users/4489f511eeab4e5aba4c1c3891db8b4f/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.553674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=48da99959ab5440fa000890eeb7cfd11, user_id=4489f511eeab4e5aba4c1c3891db8b4f, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.556342 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.619006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1231/2462] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:34:48 2022] PUT /identity/v3/projects/48da99959ab5440fa000890eeb7cfd11/users/4489f511eeab4e5aba4c1c3891db8b4f/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:34:48.638753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.639037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.639351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.667030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] MFA Rules not processed for user `4489f511eeab4e5aba4c1c3891db8b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:34:48.668370 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:48.736048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1232/2463] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:34:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:34:48.746862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:48.748562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:48.804921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb899f9-0e2f-4395-8fba-d4baee057acb admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:48.808568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:48.809202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:48.809488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:48.809764 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:48.818491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:48.819948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:48.828527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1232/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:34:52.788289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:52.790221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:52.866480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d337a86-72b2-4724-a794-b8e70ce025ce None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:52.873119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:52.873770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:52.874049 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:52.874322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:52.877013 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:52.889483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:52.891140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:52.903540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1233/2465] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:34:56.304192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:56.306569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:56.376150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da98b2d-cd92-4475-953c-27c478b58c51 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:56.381270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:56.381928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:56.382224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:56.382494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:56.384558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:56.457386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:56.459091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa2571-2cbe-4886-a8a0-25bddf7fe7cc service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:56.474703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1233/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:34:58.988510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:59.079409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9d60-6307-4de0-942f-46fb8e796793 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:59.084486 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:59.085345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:59.085630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:59.085906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] PATH_INFO: `/v3/users/4489f511eeab4e5aba4c1c3891db8b4f` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:59.087106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4489f511eeab4e5aba4c1c3891db8b4f)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:59.089382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:59.307658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4489f511eeab4e5aba4c1c3891db8b4f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:59.320438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4489f511eeab4e5aba4c1c3891db8b4f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:59.321266 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4489f511eeab4e5aba4c1c3891db8b4f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:59.321943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4489f511eeab4e5aba4c1c3891db8b4f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:59.424177 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4489f511eeab4e5aba4c1c3891db8b4f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:34:59.437237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1234/2467] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:34:58 2022] DELETE /identity/v3/users/4489f511eeab4e5aba4c1c3891db8b4f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:34:59.442096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:59.442583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:59.442696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:59.461294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:34:59.462774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:59.531048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1234/2468] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:34:59.541578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:34:59.543072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:34:59.612168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f374-a5d2-427a-a9b0-13d32628f164 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:34:59.616308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adbd0-e3c3-4aeb-b40f-b69001219d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:34:59.616997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adbd0-e3c3-4aeb-b40f-b69001219d2f service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:34:59.617384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adbd0-e3c3-4aeb-b40f-b69001219d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:34:59.617670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adbd0-e3c3-4aeb-b40f-b69001219d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:34:59.627209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adbd0-e3c3-4aeb-b40f-b69001219d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:34:59.628841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adbd0-e3c3-4aeb-b40f-b69001219d2f service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:34:59.638498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1235/2469] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:00.131974 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.133408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:00.148322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccdb41-df59-4376-828a-c517cd465db1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.153357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.154279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.154569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.154836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] PATH_INFO: `/v3/projects/48da99959ab5440fa000890eeb7cfd11` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.156112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48da99959ab5440fa000890eeb7cfd11)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.159008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:00.283799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48da99959ab5440fa000890eeb7cfd11', 'request_id': 'req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:00.289275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48da99959ab5440fa000890eeb7cfd11', 'request_id': 'req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:00.295394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48da99959ab5440fa000890eeb7cfd11', 'request_id': 'req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:00.386777 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] The token cache is being invalidate because project 48da99959ab5440fa000890eeb7cfd11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:00.387066 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:00.387712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-c32d0c3e-f87f-480a-b2f5-f129a676f1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:00.389264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1235/2470] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:00 2022] DELETE /identity/v3/projects/48da99959ab5440fa000890eeb7cfd11 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:00.394566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e27c2a-532c-4df3-9cbb-0aa9517f81c5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.395058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e27c2a-532c-4df3-9cbb-0aa9517f81c5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.396351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e27c2a-532c-4df3-9cbb-0aa9517f81c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.414736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-31e27c2a-532c-4df3-9cbb-0aa9517f81c5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:00.416069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-31e27c2a-532c-4df3-9cbb-0aa9517f81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:00.476738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1236/2471] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:00.486152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.486698 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.486799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.491308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.492456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.492456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.507791 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:00.509001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:00.509715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] MFA Rules not processed for user `08b284e21fb24a6181b70c904c22665f`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:00.510880 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:00.519390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1236/2472] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:00.523553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.533528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f321f-3da5-4c2b-b4f4-4dc49f400315 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.538385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.538877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.539156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.539451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.540168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:35:00.540471 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.542062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:00.554074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1237/2473] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:35:00.558422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.565951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1237/2474] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:35:00.568028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b014c0e-3f9b-4f53-965d-809d0b615831 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.572903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.573614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.573964 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.574303 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.575080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.577253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:00.682765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1238/2475] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:35:00 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:00.686994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.697711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f71d2-f5bc-4b06-851f-d89489238c07 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.753578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.754244 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.754522 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.754794 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.755519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.757465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:00.886677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1238/2476] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:35:00 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:00.887895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.899621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d78f0-e258-43d9-a600-575049f296da admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.904166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.904825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.905104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.905383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.906113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.908357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:00.918274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1239/2477] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:35:00.922756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.932839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc577ba-6669-4fa7-91d6-d266e4ea793e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.937576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016372b9-e42d-470c-a027-ce39e9e8e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.938225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016372b9-e42d-470c-a027-ce39e9e8e21c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.938547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016372b9-e42d-470c-a027-ce39e9e8e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.938882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016372b9-e42d-470c-a027-ce39e9e8e21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.939782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016372b9-e42d-470c-a027-ce39e9e8e21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.941384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016372b9-e42d-470c-a027-ce39e9e8e21c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:00.951689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1239/2478] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:00.956209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:00.966867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851acca-9764-4baa-8707-f0bb06afa438 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:00.973096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:00.974074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:00.974427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:00.974776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] PATH_INFO: `/v3/projects/cb2285dc672145658dbed4d8d08829f2/users/3c1294632a6140a3839985ca5ad3b5c3/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:00.990773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2285dc672145658dbed4d8d08829f2, user_id=3c1294632a6140a3839985ca5ad3b5c3, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:00.993737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.069717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1240/2479] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:00 2022] PUT /identity/v3/projects/cb2285dc672145658dbed4d8d08829f2/users/3c1294632a6140a3839985ca5ad3b5c3/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:01.080640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.081980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.081980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.108737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] MFA Rules not processed for user `3c1294632a6140a3839985ca5ad3b5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:01.110699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:01.172799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1240/2480] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:01.177356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:01.243838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa600f-ee4a-4bd2-bf88-29dd827b380f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:01.248622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:01.249276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.249560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.249837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.250523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:01.254476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.332091 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1241/2481] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:35:01 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:01.345838 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:01.357215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0437d6-6908-4389-9cde-38342c979550 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:01.412968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:01.413666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.413944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.414217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.414884 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:01.416826 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.558712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1241/2482] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:35:01 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:01.562623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:01.573119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cc0b8-e83c-4d7f-9ba1-8680221a608b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:01.577590 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:01.578241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.578524 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.578800 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.580286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:01.581899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.601611 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1242/2483] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:01.603051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:01.613144 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415a0a-e3e9-4fc3-a8ee-fe593b81eeba admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:01.617704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:01.618600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.618916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.619190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] PATH_INFO: `/v3/projects/1ae63be1ccb64d5e9487e4cd405e24f1/users/97e4a953c5b5474cba71b6faf37f7cb0/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.634995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae63be1ccb64d5e9487e4cd405e24f1, user_id=97e4a953c5b5474cba71b6faf37f7cb0, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:01.637811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.792571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1242/2484] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:01 2022] PUT /identity/v3/projects/1ae63be1ccb64d5e9487e4cd405e24f1/users/97e4a953c5b5474cba71b6faf37f7cb0/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:01.796966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:01.807324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d730-f8a9-4cbf-9991-50696493829d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:01.863754 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab95f-b271-491a-8d48-edca5c3de647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:01.864337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab95f-b271-491a-8d48-edca5c3de647 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.864622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab95f-b271-491a-8d48-edca5c3de647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.864901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab95f-b271-491a-8d48-edca5c3de647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.865619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab95f-b271-491a-8d48-edca5c3de647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:01.867204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab95f-b271-491a-8d48-edca5c3de647 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.877957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1243/2485] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:01.882080 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:01.892636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332638-ede3-440f-9ca6-dcd78401e994 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:01.897274 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:01.898169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.898434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.898710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] PATH_INFO: `/v3/projects/1ae63be1ccb64d5e9487e4cd405e24f1/users/97e4a953c5b5474cba71b6faf37f7cb0/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.900748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae63be1ccb64d5e9487e4cd405e24f1, user_id=97e4a953c5b5474cba71b6faf37f7cb0, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:01.903411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:01.913565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1243/2486] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:01 2022] PUT /identity/v3/projects/1ae63be1ccb64d5e9487e4cd405e24f1/users/97e4a953c5b5474cba71b6faf37f7cb0/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:01.924744 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:01.925044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:01.925324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:01.951884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] MFA Rules not processed for user `97e4a953c5b5474cba71b6faf37f7cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:01.953107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:02.033182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1244/2487] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:02.050607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:02.050607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:02.104918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f638ae-a2e7-4eac-b24a-24fa347649e1 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:02.108575 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddb0a7-0db1-4c3a-b2d8-67af2b654f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:02.109221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddb0a7-0db1-4c3a-b2d8-67af2b654f57 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:02.109501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddb0a7-0db1-4c3a-b2d8-67af2b654f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:02.109776 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddb0a7-0db1-4c3a-b2d8-67af2b654f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:02.120036 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddb0a7-0db1-4c3a-b2d8-67af2b654f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:02.121403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddb0a7-0db1-4c3a-b2d8-67af2b654f57 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:02.130967 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1244/2488] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:02.257888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:02.319953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e764567-83ab-408f-9d30-5ed323d81804 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:02.324454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:02.325317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:02.325600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:02.325878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] PATH_INFO: `/v3/users/3c1294632a6140a3839985ca5ad3b5c3` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:02.327056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1294632a6140a3839985ca5ad3b5c3)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:02.329011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:02.646521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1294632a6140a3839985ca5ad3b5c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:02.653073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1294632a6140a3839985ca5ad3b5c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:02.653884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1294632a6140a3839985ca5ad3b5c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:02.654480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1294632a6140a3839985ca5ad3b5c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:02.666455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1294632a6140a3839985ca5ad3b5c3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:02.752894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1245/2489] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:02 2022] DELETE /identity/v3/users/3c1294632a6140a3839985ca5ad3b5c3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:02.757510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:02.757968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:02.758086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:02.776465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:02.777667 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:02.836279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1245/2490] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:02.846993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:02.848588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:02.906086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ffce-1c16-4553-815c-2a4af090b781 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:02.909780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:02.910421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:02.910706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:02.910984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:02.920318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:02.921797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:02.931973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1246/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:03.365702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:03.367751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:03.383511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e65e0-015e-4903-89f7-42cccb5798ff None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:03.390617 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:03.392179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:03.392638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:03.393271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] PATH_INFO: `/v3/projects/cb2285dc672145658dbed4d8d08829f2` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:03.394741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2285dc672145658dbed4d8d08829f2)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:03.397171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:03.529681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2285dc672145658dbed4d8d08829f2', 'request_id': 'req-5073a421-d922-45d4-bcd7-8acb24825f75'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.618346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2285dc672145658dbed4d8d08829f2', 'request_id': 'req-5073a421-d922-45d4-bcd7-8acb24825f75'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.624660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2285dc672145658dbed4d8d08829f2', 'request_id': 'req-5073a421-d922-45d4-bcd7-8acb24825f75'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.636307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] The token cache is being invalidate because project cb2285dc672145658dbed4d8d08829f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:03.636638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.637319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.638883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1246/2492] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:03 2022] DELETE /identity/v3/projects/cb2285dc672145658dbed4d8d08829f2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:03.642880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:03.652480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b730524-83c3-4b93-91fa-6028b3f22f7d service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:03.711981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:03.712763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:03.713085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:03.713317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] PATH_INFO: `/v3/users/97e4a953c5b5474cba71b6faf37f7cb0` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:03.714762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e4a953c5b5474cba71b6faf37f7cb0)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:03.716713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:03.931550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e4a953c5b5474cba71b6faf37f7cb0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.938133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e4a953c5b5474cba71b6faf37f7cb0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.939185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e4a953c5b5474cba71b6faf37f7cb0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.939839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e4a953c5b5474cba71b6faf37f7cb0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:03.951089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fca0db6e-c945-4305-a788-925a6682189a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e4a953c5b5474cba71b6faf37f7cb0'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:04.075198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1247/2493] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:03 2022] DELETE /identity/v3/users/97e4a953c5b5474cba71b6faf37f7cb0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:04.669803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:04.672287 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:04.699152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a421-d922-45d4-bcd7-8acb24825f75 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:04.773907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:04.774694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:04.774973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:04.775297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] PATH_INFO: `/v3/projects/1ae63be1ccb64d5e9487e4cd405e24f1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:04.776481 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae63be1ccb64d5e9487e4cd405e24f1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:04.778391 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:04.905913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae63be1ccb64d5e9487e4cd405e24f1', 'request_id': 'req-7ebc1953-5da2-47a6-a891-cce242137f20'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:05.009419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae63be1ccb64d5e9487e4cd405e24f1', 'request_id': 'req-7ebc1953-5da2-47a6-a891-cce242137f20'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:05.015542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae63be1ccb64d5e9487e4cd405e24f1', 'request_id': 'req-7ebc1953-5da2-47a6-a891-cce242137f20'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:05.026735 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] The token cache is being invalidate because project 1ae63be1ccb64d5e9487e4cd405e24f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:05.027025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:05.027718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7ebc1953-5da2-47a6-a891-cce242137f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:05.029278 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1247/2494] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:04 2022] DELETE /identity/v3/projects/1ae63be1ccb64d5e9487e4cd405e24f1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:05.035007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.035573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.035746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.053839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:05.055073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:05.115341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1248/2495] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:35:05.124752 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.125069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.125378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.143986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:05.145165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:05.153022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1248/2496] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:05.158135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.167702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702a839-0c2f-4780-8342-f67cabdc074b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.172316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.173729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.174240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.174525 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.175246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:35:05.175583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.177179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:05.188605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1249/2497] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:35:05.195783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.205646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166b86a-8a58-414c-8985-03d30512f70d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.210621 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.211305 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.211595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.211927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.212628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.214864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:05.370383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1249/2498] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:35:05 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:05.374511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.385280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e7843-8ec8-480d-b2be-53cdeb43e8a2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.442950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.443655 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.443946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.444224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.444908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.446831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:05.601001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1250/2499] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:35:05 2022] POST /identity/v3/users => generated 305 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:05.602174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.613229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01818c0-2385-4e1b-b13d-50f98fe39911 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.622170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.622170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.622170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.622170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.622517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.623530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:05.636051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1250/2500] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:05.640136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.656270 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08266-2914-45d4-9e6b-d15e27e40651 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.659526 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e397f93-da10-4490-ad06-51849c97f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.660267 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e397f93-da10-4490-ad06-51849c97f54b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.660547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e397f93-da10-4490-ad06-51849c97f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.660819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e397f93-da10-4490-ad06-51849c97f54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.661554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e397f93-da10-4490-ad06-51849c97f54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.663340 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e397f93-da10-4490-ad06-51849c97f54b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:05.675537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1251/2501] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:05.679394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.690656 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22401a-66bf-4872-bc2b-984099e75aba admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.695907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.696814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.697098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.697379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] PATH_INFO: `/v3/projects/5d72abb2636d4006810d17092ad80030/users/97251e5474474cdfa3b0879cbafab5ab/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.714573 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d72abb2636d4006810d17092ad80030, user_id=97251e5474474cdfa3b0879cbafab5ab, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.717292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:05.800798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1251/2502] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:05 2022] PUT /identity/v3/projects/5d72abb2636d4006810d17092ad80030/users/97251e5474474cdfa3b0879cbafab5ab/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:05.809286 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.816769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.816769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.837891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] MFA Rules not processed for user `97251e5474474cdfa3b0879cbafab5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:05.839434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:05.905942 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1252/2503] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:05.910907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:05.979563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090fec7-4bde-4b82-a334-b3b82bd8111e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:05.984268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:05.985045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:05.985962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:05.986442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:05.987126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:05.989116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.125483 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1252/2504] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:35:05 2022] POST /identity/v3/projects => generated 409 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:35:06.130104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:06.141135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d0a6-4781-49d0-b92d-d59eca8d8f3f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:06.198576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:06.199222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.199505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.199788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.200489 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:06.202412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.333495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1253/2505] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:35:06 2022] POST /identity/v3/users => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:35:06.337598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:06.348824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7824-727d-43cd-8b4b-c5ebfe3981f5 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:06.353420 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:06.354115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.354399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.354678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.355438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:06.357026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.367412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1253/2506] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:06.371390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:06.381384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c4e1-d648-4912-8250-8912936bc768 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:06.385923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:06.386815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.387072 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.387377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] PATH_INFO: `/v3/projects/0466c9b494624f5b9c71368202059a6d/users/f835a7e83eb64ddab8b75c8e3ff58df2/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.402209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0466c9b494624f5b9c71368202059a6d, user_id=f835a7e83eb64ddab8b75c8e3ff58df2, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:06.404877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.536121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1254/2507] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:06 2022] PUT /identity/v3/projects/0466c9b494624f5b9c71368202059a6d/users/f835a7e83eb64ddab8b75c8e3ff58df2/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:06.540194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:06.550209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83573ae1-8a4c-4476-b4ac-502765c7f3ba admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:06.605226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6106189-5305-439b-869a-c7277dd8a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:06.605885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6106189-5305-439b-869a-c7277dd8a104 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.606170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6106189-5305-439b-869a-c7277dd8a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.606449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6106189-5305-439b-869a-c7277dd8a104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.607169 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6106189-5305-439b-869a-c7277dd8a104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:06.608788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6106189-5305-439b-869a-c7277dd8a104 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.619445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1254/2508] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:06.623776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:06.634505 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a35d2e-0171-478f-a616-4feaaae4a55b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:06.639172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:06.640080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.640371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.640652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] PATH_INFO: `/v3/projects/0466c9b494624f5b9c71368202059a6d/users/f835a7e83eb64ddab8b75c8e3ff58df2/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.643237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0466c9b494624f5b9c71368202059a6d, user_id=f835a7e83eb64ddab8b75c8e3ff58df2, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:06.645884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.655959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1255/2509] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:06 2022] PUT /identity/v3/projects/0466c9b494624f5b9c71368202059a6d/users/f835a7e83eb64ddab8b75c8e3ff58df2/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:06.667014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.667325 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.667631 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.693329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] MFA Rules not processed for user `f835a7e83eb64ddab8b75c8e3ff58df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:06.694504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:06.760110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1255/2510] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:35:06.772053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:06.773756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:06.837711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019c038-7860-4615-ab2b-2bd99e7fd5f3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:06.841688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:06.842329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:06.842615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:06.842892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:06.851932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:06.853354 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:06.862509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1256/2511] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:07.220898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:07.230387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37a30-c508-4056-9a51-50154f2ab1ed None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:07.233969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf651-5e3d-4538-b205-f68b80e0380f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:07.234607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf651-5e3d-4538-b205-f68b80e0380f service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:07.234919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf651-5e3d-4538-b205-f68b80e0380f service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:07.235721 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf651-5e3d-4538-b205-f68b80e0380f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:07.290727 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf651-5e3d-4538-b205-f68b80e0380f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:07.292195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf651-5e3d-4538-b205-f68b80e0380f service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:07.301608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1256/2512] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:18.855176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:18.916240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9675-c104-4cba-b3c9-bfdf19255923 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:18.920709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:18.921619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:18.921907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:18.922183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] PATH_INFO: `/v3/users/97251e5474474cdfa3b0879cbafab5ab` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:18.924171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97251e5474474cdfa3b0879cbafab5ab)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:18.926146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:19.149264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97251e5474474cdfa3b0879cbafab5ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:19.155983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97251e5474474cdfa3b0879cbafab5ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:19.156662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97251e5474474cdfa3b0879cbafab5ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:19.160134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97251e5474474cdfa3b0879cbafab5ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:19.172269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97251e5474474cdfa3b0879cbafab5ab'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:19.246318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1257/2513] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:18 2022] DELETE /identity/v3/users/97251e5474474cdfa3b0879cbafab5ab => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:19.251905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:19.252460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:19.252775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:19.270289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:19.271747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:19.330854 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1257/2514] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:19.340993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:19.342434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:19.400438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a15c7-9700-4bee-9022-285b9233442a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:19.403969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:19.404635 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:19.404898 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:19.405172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:19.414215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:19.415677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:19.425351 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1258/2515] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:19.905012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:19.906425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:19.919212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c161-bf99-48b3-989f-d6efe04ea7fb None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:19.924848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:19.926023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:19.926306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:19.926581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] PATH_INFO: `/v3/projects/5d72abb2636d4006810d17092ad80030` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:19.927836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d72abb2636d4006810d17092ad80030)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:19.929829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:20.075431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d72abb2636d4006810d17092ad80030', 'request_id': 'req-e1e4c310-d771-4c6d-89bd-5240a573c46b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.152684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d72abb2636d4006810d17092ad80030', 'request_id': 'req-e1e4c310-d771-4c6d-89bd-5240a573c46b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.160375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d72abb2636d4006810d17092ad80030', 'request_id': 'req-e1e4c310-d771-4c6d-89bd-5240a573c46b'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.171684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] The token cache is being invalidate because project 5d72abb2636d4006810d17092ad80030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:20.172068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.173590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.175322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1258/2516] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:19 2022] DELETE /identity/v3/projects/5d72abb2636d4006810d17092ad80030 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:20.179412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:20.192771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e0ccf-3ba5-49c4-964a-efe3709ce691 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:20.249811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:20.250717 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:20.251006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:20.251310 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] PATH_INFO: `/v3/users/f835a7e83eb64ddab8b75c8e3ff58df2` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:20.252507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f835a7e83eb64ddab8b75c8e3ff58df2)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:20.254425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:20.470813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f835a7e83eb64ddab8b75c8e3ff58df2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.489287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f835a7e83eb64ddab8b75c8e3ff58df2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.490027 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f835a7e83eb64ddab8b75c8e3ff58df2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.490656 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f835a7e83eb64ddab8b75c8e3ff58df2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.504737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-87dfd061-ebe2-45b9-b3a5-c45e72db801d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f835a7e83eb64ddab8b75c8e3ff58df2'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:20.609749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1259/2517] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:20 2022] DELETE /identity/v3/users/f835a7e83eb64ddab8b75c8e3ff58df2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:21.308378 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:21.309897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:21.323948 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c310-d771-4c6d-89bd-5240a573c46b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:21.410215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:21.411100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:21.411421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:21.411701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] PATH_INFO: `/v3/projects/0466c9b494624f5b9c71368202059a6d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:21.414848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0466c9b494624f5b9c71368202059a6d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:21.416848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:21.567400 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0466c9b494624f5b9c71368202059a6d', 'request_id': 'req-8a114ed7-a602-4d5c-97e7-7ffd13eada99'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:21.633074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0466c9b494624f5b9c71368202059a6d', 'request_id': 'req-8a114ed7-a602-4d5c-97e7-7ffd13eada99'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:21.640226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0466c9b494624f5b9c71368202059a6d', 'request_id': 'req-8a114ed7-a602-4d5c-97e7-7ffd13eada99'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:21.655112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] The token cache is being invalidate because project 0466c9b494624f5b9c71368202059a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:21.655535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:21.656543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8a114ed7-a602-4d5c-97e7-7ffd13eada99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:21.658652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1259/2518] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:21 2022] DELETE /identity/v3/projects/0466c9b494624f5b9c71368202059a6d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:21.664968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:21.665473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:21.665561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:21.684320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:21.685686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:21.756205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1260/2519] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:35:21.763728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:21.764020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:21.764303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:21.785595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:21.786933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:21.796401 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1260/2520] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:21.805750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:21.816522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8cd78-0ef0-470a-b5b8-818bde1cc9b6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:21.821529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:21.822179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:21.822485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:21.822765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:21.823516 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:35:21.823826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:21.825508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:21.837946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1261/2521] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:35:21.842741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:21.852156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1764b93-c5c6-4e80-9aa8-707af2da5b77 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:21.856909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:21.857553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:21.857835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:21.858110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:21.858791 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:21.861279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:21.997634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1261/2522] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:35:21 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:22.002730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:22.014241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead529-0028-4d4f-9222-c3570c904c11 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:22.095464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:22.096231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:22.097088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:22.097652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:22.098500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:22.100570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:22.242449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1262/2523] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:35:22 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:22.246644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:22.260002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147081-0c2d-4dcf-904d-b0865a0db79c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:22.274022 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:22.274730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:22.275064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:22.275375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:22.278618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:22.278618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:22.289229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1262/2524] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:22.293367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:22.303958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375bb19-68fb-400c-91e1-346374e14241 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:22.308978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e6ff4-c1e9-401f-bb4e-bfe2f451d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:22.313127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6ff4-c1e9-401f-bb4e-bfe2f451d40f admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:22.313127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6ff4-c1e9-401f-bb4e-bfe2f451d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:22.313127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6ff4-c1e9-401f-bb4e-bfe2f451d40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:22.313127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e6ff4-c1e9-401f-bb4e-bfe2f451d40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:22.313127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e6ff4-c1e9-401f-bb4e-bfe2f451d40f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:22.322519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1263/2525] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:22.326485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:22.336171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9f1d-d388-4ae7-9399-bf7fbdf44840 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:22.340877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:22.341879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:22.342175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:22.342425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] PATH_INFO: `/v3/projects/1ca2ebe0579c4c1b8436e9f730734222/users/a49d706eed474df89b648c6051d97e97/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:22.357102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca2ebe0579c4c1b8436e9f730734222, user_id=a49d706eed474df89b648c6051d97e97, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:22.359823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:22.440485 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1263/2526] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:22 2022] PUT /identity/v3/projects/1ca2ebe0579c4c1b8436e9f730734222/users/a49d706eed474df89b648c6051d97e97/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:22.454235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307831b-6fe3-4664-9ac3-3af59d68b5c6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:22.454690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307831b-6fe3-4664-9ac3-3af59d68b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:22.455159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307831b-6fe3-4664-9ac3-3af59d68b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:22.481956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b307831b-6fe3-4664-9ac3-3af59d68b5c6 None None] MFA Rules not processed for user `a49d706eed474df89b648c6051d97e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:22.483146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b307831b-6fe3-4664-9ac3-3af59d68b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:22.554252 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1264/2527] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:22.565885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:22.567726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:22.634630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395177a-97f4-4b03-b807-fdccdba9d2cc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:22.638282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:22.638922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:22.639214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:22.639532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:22.649247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:22.650691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:22.661504 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1264/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:35:23.416890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3be97-6050-46ee-8f2a-d94dc8980e8a None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:23.417380 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3be97-6050-46ee-8f2a-d94dc8980e8a None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:23.417473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3be97-6050-46ee-8f2a-d94dc8980e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:23.435713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-77c3be97-6050-46ee-8f2a-d94dc8980e8a None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:23.436908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-77c3be97-6050-46ee-8f2a-d94dc8980e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:23.494832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1265/2529] 10.222.0.42 () {58 vars in 967 bytes} [Tue May 3 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:35:23.625217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:23.627660 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:23.700916 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4992b-4a8d-4b0c-9c0b-ae7703b55fd1 service glance] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:23.706961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:23.707657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:23.707941 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:23.708218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:23.716973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:23.718598 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:23.728127 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1265/2530] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:35:24.712100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627496d6-4552-4357-95a7-703b3606d763 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:24.712638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627496d6-4552-4357-95a7-703b3606d763 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:24.712638 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627496d6-4552-4357-95a7-703b3606d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:24.731726 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-627496d6-4552-4357-95a7-703b3606d763 None None] MFA Rules not processed for user `bc1eb5755b1549e0b50c6f6a701a0d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:24.732934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-627496d6-4552-4357-95a7-703b3606d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:24.791875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1266/2531] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:33.975087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:33.979726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:34.042176 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f31ea-edf7-46c2-8fa3-b45a81098588 service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:34.046724 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:34.048444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:34.048444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:34.048444 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] PATH_INFO: `/v3/users/a0704dbb1f7e4d0f8a1c80eeea0b770c` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:34.049545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0704dbb1f7e4d0f8a1c80eeea0b770c)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:34.051484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:34.291014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0704dbb1f7e4d0f8a1c80eeea0b770c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.302796 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0704dbb1f7e4d0f8a1c80eeea0b770c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.308125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0704dbb1f7e4d0f8a1c80eeea0b770c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.308125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0704dbb1f7e4d0f8a1c80eeea0b770c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.411277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0704dbb1f7e4d0f8a1c80eeea0b770c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.424189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1266/2532] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:33 2022] DELETE /identity/v3/users/a0704dbb1f7e4d0f8a1c80eeea0b770c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:34.697546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627496d6-4552-4357-95a7-703b3606d763 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:34.711052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627496d6-4552-4357-95a7-703b3606d763 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:34.775169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:34.776156 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:34.776497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:34.776699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] PATH_INFO: `/v3/projects/0866e0526e8342e485bb8714c59ed834` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:34.777880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0866e0526e8342e485bb8714c59ed834)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:34.779892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:34.877856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0866e0526e8342e485bb8714c59ed834', 'request_id': 'req-b74709c7-51ac-42e8-a574-1db36fbfa970'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.882919 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0866e0526e8342e485bb8714c59ed834', 'request_id': 'req-b74709c7-51ac-42e8-a574-1db36fbfa970'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.889003 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0866e0526e8342e485bb8714c59ed834', 'request_id': 'req-b74709c7-51ac-42e8-a574-1db36fbfa970'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.988273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] The token cache is being invalidate because project 0866e0526e8342e485bb8714c59ed834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:34.988603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.989240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:34.990833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1267/2533] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:34 2022] DELETE /identity/v3/projects/0866e0526e8342e485bb8714c59ed834 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:34.994961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:34.996535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:35.010139 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682878-71b3-4f8a-b6f6-2261420f9782 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:35.065901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:35.066789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:35.067070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:35.067375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] PATH_INFO: `/v3/users/0944a8fd232244f9bbf64fd205bb9182` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:35.068595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0944a8fd232244f9bbf64fd205bb9182)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:35.070514 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:35.303061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0944a8fd232244f9bbf64fd205bb9182'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.314294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0944a8fd232244f9bbf64fd205bb9182'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.314947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0944a8fd232244f9bbf64fd205bb9182'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.315570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0944a8fd232244f9bbf64fd205bb9182'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.455597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0944a8fd232244f9bbf64fd205bb9182'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.468133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1267/2534] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:34 2022] DELETE /identity/v3/users/0944a8fd232244f9bbf64fd205bb9182 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:35.710673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:35.710673 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:35.724381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74709c7-51ac-42e8-a574-1db36fbfa970 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:35.781869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:35.782753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:35.783031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:35.783330 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] PATH_INFO: `/v3/projects/aa63334d788a4e798eff8ba08d4d71e7` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:35.784495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa63334d788a4e798eff8ba08d4d71e7)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:35.786383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:35.917311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa63334d788a4e798eff8ba08d4d71e7', 'request_id': 'req-b6d638d5-69f7-49cf-ad3e-3f9169afa426'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.922947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa63334d788a4e798eff8ba08d4d71e7', 'request_id': 'req-b6d638d5-69f7-49cf-ad3e-3f9169afa426'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:35.929266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa63334d788a4e798eff8ba08d4d71e7', 'request_id': 'req-b6d638d5-69f7-49cf-ad3e-3f9169afa426'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:36.039085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] The token cache is being invalidate because project aa63334d788a4e798eff8ba08d4d71e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:36.039409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:36.040045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b6d638d5-69f7-49cf-ad3e-3f9169afa426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:36.041568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1268/2535] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:35 2022] DELETE /identity/v3/projects/aa63334d788a4e798eff8ba08d4d71e7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:47.261924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:47.263344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:47.276808 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f332-fca1-4d7a-a23a-011a505dff1e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:47.333188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:47.334048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:47.334329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:47.334628 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] PATH_INFO: `/v3/users/a49d706eed474df89b648c6051d97e97` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:47.335823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49d706eed474df89b648c6051d97e97)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:47.337979 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:47.559495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49d706eed474df89b648c6051d97e97'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:47.571452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49d706eed474df89b648c6051d97e97'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:47.572102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49d706eed474df89b648c6051d97e97'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:47.572694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49d706eed474df89b648c6051d97e97'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:47.648993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49d706eed474df89b648c6051d97e97'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:47.661906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1268/2536] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:35:47 2022] DELETE /identity/v3/users/a49d706eed474df89b648c6051d97e97 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:47.666675 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:47.667161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:47.667296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:47.685346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:47.686533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:47.745849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1269/2537] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:47.755407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:47.756911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:47.814045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ad18-a67a-46fd-861e-83c535cbcd45 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:47.818136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cd143-bb74-49f6-8981-ab06e559b5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:47.818767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cd143-bb74-49f6-8981-ab06e559b5eb service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:47.819050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cd143-bb74-49f6-8981-ab06e559b5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:47.819352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cd143-bb74-49f6-8981-ab06e559b5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:47.828115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cd143-bb74-49f6-8981-ab06e559b5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:47.829544 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cd143-bb74-49f6-8981-ab06e559b5eb service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:47.839596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1269/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:48.264209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:48.265651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:48.279068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b1fa9-31cc-4795-8c70-8ad1a4100d46 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:48.284117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:48.285969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.286258 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.286539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] PATH_INFO: `/v3/projects/1ca2ebe0579c4c1b8436e9f730734222` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.287803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca2ebe0579c4c1b8436e9f730734222)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:48.289825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:48.405070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca2ebe0579c4c1b8436e9f730734222', 'request_id': 'req-f004b168-a21e-47e5-a538-a354a3d0d92d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:48.411086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca2ebe0579c4c1b8436e9f730734222', 'request_id': 'req-f004b168-a21e-47e5-a538-a354a3d0d92d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:48.417241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca2ebe0579c4c1b8436e9f730734222', 'request_id': 'req-f004b168-a21e-47e5-a538-a354a3d0d92d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:48.488399 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] The token cache is being invalidate because project 1ca2ebe0579c4c1b8436e9f730734222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:35:48.488687 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:48.489317 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f004b168-a21e-47e5-a538-a354a3d0d92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:35:48.490921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1270/2539] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:35:48 2022] DELETE /identity/v3/projects/1ca2ebe0579c4c1b8436e9f730734222 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:48.495853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.496338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.496435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.514751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:48.515963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:48.572836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1270/2540] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:48.582325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.582609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.582886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.601105 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:48.604135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:48.610161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1271/2541] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:48.614455 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:48.624664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87e68-2e41-426a-9e07-99e8c7bbdb77 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:48.630695 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:48.632827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.632827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.632827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.633839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:35:48.634171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:48.635819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:48.648466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1271/2542] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:35:48.652787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:48.661989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74bb26-79de-41eb-aeff-7ab666b5ec98 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:48.666592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:48.667239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.667812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.667812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.668490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:48.670383 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:48.773700 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1272/2543] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:35:48 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:48.777589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:48.788306 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a7626-9fc5-4d4c-a01e-a1818aec0613 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:48.844083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:48.844738 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.845020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.845294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.845962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:48.847958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:48.951333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1272/2544] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:35:48 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:35:48.955347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:48.966053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916dc2f-ff73-4fe4-ab05-84c7e3937a88 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:48.970616 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:48.971275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:48.973300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:48.973300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:48.973300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:48.974374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:48.984768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1273/2545] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:48.989473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:48.999784 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74332db-b0a0-4d1d-b662-55e5238f5328 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:49.005723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea98c2-9c03-40fa-aefb-412449e7b41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:49.007835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea98c2-9c03-40fa-aefb-412449e7b41c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:49.007835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea98c2-9c03-40fa-aefb-412449e7b41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:49.007835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea98c2-9c03-40fa-aefb-412449e7b41c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:49.007835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea98c2-9c03-40fa-aefb-412449e7b41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:49.009214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea98c2-9c03-40fa-aefb-412449e7b41c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:49.019490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1273/2546] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:35:49.023680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:49.033506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660148f-6e8f-4226-b2bf-4466ce9267aa admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:49.038044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:49.038907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:49.039187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:49.039497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] PATH_INFO: `/v3/projects/f8466051fcdd4b58b8e27cb2e0285462/users/ebebee0c2cb04146b498084b1601b25e/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:49.054462 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8466051fcdd4b58b8e27cb2e0285462, user_id=ebebee0c2cb04146b498084b1601b25e, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:49.057191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:49.154071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1274/2547] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:35:49 2022] PUT /identity/v3/projects/f8466051fcdd4b58b8e27cb2e0285462/users/ebebee0c2cb04146b498084b1601b25e/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:35:49.159897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28227f6-e11a-4a9b-a25e-0c4bed9e73f5 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:49.160195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28227f6-e11a-4a9b-a25e-0c4bed9e73f5 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:49.160481 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28227f6-e11a-4a9b-a25e-0c4bed9e73f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:49.179040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a28227f6-e11a-4a9b-a25e-0c4bed9e73f5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:49.180353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a28227f6-e11a-4a9b-a25e-0c4bed9e73f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:49.236640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1274/2548] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:35:49.247597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:49.249266 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:49.306521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddd0df-c0bb-4faa-9d2e-8e1d1d98312e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:49.310086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:49.310719 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:49.310996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:49.311279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:49.320543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:49.321989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:49.331248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1275/2549] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:50.575927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeecc7-1876-49df-b08f-468b600fae58 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:50.576445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeecc7-1876-49df-b08f-468b600fae58 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:50.576678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeecc7-1876-49df-b08f-468b600fae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:50.603480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-45eeecc7-1876-49df-b08f-468b600fae58 None None] MFA Rules not processed for user `ebebee0c2cb04146b498084b1601b25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:50.604674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-45eeecc7-1876-49df-b08f-468b600fae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:50.671997 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1275/2550] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:35:50.684960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:35:50.686421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:50.741776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20a7c3-2408-42c3-8aac-53f47bfd7cdb service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:35:50.745379 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46b8b-7155-4b70-9f36-fa5d2dc2b6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:35:50.746011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46b8b-7155-4b70-9f36-fa5d2dc2b6ae service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:50.746294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46b8b-7155-4b70-9f36-fa5d2dc2b6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:50.746569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46b8b-7155-4b70-9f36-fa5d2dc2b6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:50.755477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46b8b-7155-4b70-9f36-fa5d2dc2b6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:35:50.756930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46b8b-7155-4b70-9f36-fa5d2dc2b6ae service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:35:50.765776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1276/2551] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:35:52.485124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:35:52.485644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:35:52.485761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:35:52.504113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] MFA Rules not processed for user `ebebee0c2cb04146b498084b1601b25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:35:52.505308 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:35:52.512258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1276/2552] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:36:10.611503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17575-820b-46c2-8aa0-d175c398cc66 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:10.612047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17575-820b-46c2-8aa0-d175c398cc66 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:10.612047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b17575-820b-46c2-8aa0-d175c398cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:10.629099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d8b17575-820b-46c2-8aa0-d175c398cc66 None None] MFA Rules not processed for user `ebebee0c2cb04146b498084b1601b25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:36:10.630978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d8b17575-820b-46c2-8aa0-d175c398cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:10.637940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1277/2553] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:36:12.105568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:12.106960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:12.175311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370619-5bb2-4898-8df7-dfd372e74ddf None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:12.181115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:12.181756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:12.182042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:12.182319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:12.184502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:12.197076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:12.198688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:12.209178 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1277/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:36:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:36:36.134660 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fca1e-ec27-4cfb-818b-a0149f55f225 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:36.137513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fca1e-ec27-4cfb-818b-a0149f55f225 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:36.137513 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fca1e-ec27-4cfb-818b-a0149f55f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:36.154250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-4d6fca1e-ec27-4cfb-818b-a0149f55f225 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:36:36.155461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4d6fca1e-ec27-4cfb-818b-a0149f55f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:36.208176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1278/2555] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:36:36.332780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:36.334196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:36.403801 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b241-55fb-40fe-ad25-7d1ded113e01 service placement] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:36.408975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:36.409622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:36.409907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:36.410181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:36.418494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:36.420093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:36.427919 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1278/2556] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:36:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:36:52.707430 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:52.707910 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:52.708011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:52.726059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:36:52.727242 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:52.734344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1279/2557] 10.222.0.42 () {58 vars in 967 bytes} [Tue May 3 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:36:52.747038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:52.757539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b41a55-db42-43bc-b616-70c96b102ee0 service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:52.762591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:52.763221 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:52.763537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:52.763814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:52.771785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:52.773307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:52.781629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1279/2558] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:36:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:36:56.099879 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:56.113184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e8ed6-d2f5-4707-a537-31f651da42e9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:56.116622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:56.117485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:56.117767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:56.118037 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] PATH_INFO: `/v3/users/ebebee0c2cb04146b498084b1601b25e` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:56.119210 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebebee0c2cb04146b498084b1601b25e)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:56.121137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:56.335468 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebebee0c2cb04146b498084b1601b25e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.343550 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebebee0c2cb04146b498084b1601b25e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.344241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebebee0c2cb04146b498084b1601b25e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.344916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebebee0c2cb04146b498084b1601b25e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.357734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f0214dfa-936c-41b6-a982-82b48c5b865b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebebee0c2cb04146b498084b1601b25e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.454677 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1280/2559] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:36:56 2022] DELETE /identity/v3/users/ebebee0c2cb04146b498084b1601b25e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:36:56.684320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:56.697109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162c22b-acf0-4481-b7e4-1969ed105446 service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:56.756774 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:56.757910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:56.757910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:56.758167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] PATH_INFO: `/v3/projects/f8466051fcdd4b58b8e27cb2e0285462` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:56.759403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8466051fcdd4b58b8e27cb2e0285462)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:56.761336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:56.894956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8466051fcdd4b58b8e27cb2e0285462', 'request_id': 'req-defa8ead-5344-4d98-875e-fdef18762bcf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.974790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8466051fcdd4b58b8e27cb2e0285462', 'request_id': 'req-defa8ead-5344-4d98-875e-fdef18762bcf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.984330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8466051fcdd4b58b8e27cb2e0285462', 'request_id': 'req-defa8ead-5344-4d98-875e-fdef18762bcf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.996704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] The token cache is being invalidate because project f8466051fcdd4b58b8e27cb2e0285462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:36:56.996986 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:56.997645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-defa8ead-5344-4d98-875e-fdef18762bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:36:57.002131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1280/2560] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:36:56 2022] DELETE /identity/v3/projects/f8466051fcdd4b58b8e27cb2e0285462 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:36:57.005543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.005794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.006077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.025009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:36:57.026221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:57.084459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1281/2561] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:36:57.093025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.093392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.093677 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.113253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:36:57.114442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:57.122460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1281/2562] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:36:57.126639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.136996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859c52-7992-48ac-8b35-b253533d2de5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.141568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.142212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.142491 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.142765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.143522 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:36:57.143828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.145413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.157449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1282/2563] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:36:57.161797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.171029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbef9c-2eb2-4bd3-9899-cc2b55aee0f3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.176377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.176377 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.176668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.176947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.177640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.179733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.262094 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1282/2564] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:36:57 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:36:57.266264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.277651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81880-121c-4137-bdc2-89b3c8a74d05 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.333779 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.334438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.334720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.334993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.336233 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.338165 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.437937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1283/2565] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:36:57 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:36:57.441970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.453118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72b8d-b902-4996-a098-c168b300d136 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.457718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.458388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.458679 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.458950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.459694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.462042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.472476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1283/2566] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:36:57.477025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.486745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656615b-9d17-4dc6-953c-599f72f1fb5f admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.491322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d341080-a431-4173-9340-679aa6bc9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.492032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d341080-a431-4173-9340-679aa6bc9108 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.492292 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d341080-a431-4173-9340-679aa6bc9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.492605 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d341080-a431-4173-9340-679aa6bc9108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.493281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d341080-a431-4173-9340-679aa6bc9108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.494868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d341080-a431-4173-9340-679aa6bc9108 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.504952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1284/2567] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:36:57.509519 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.519449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf157f5-bcc2-4541-a4aa-25a5c7f648db admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.524943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.525812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.526091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.526362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] PATH_INFO: `/v3/projects/625ca7a1c3734d4babebd407aa736387/users/e59474a509034eb4a89becc3e16c31c2/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.541472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625ca7a1c3734d4babebd407aa736387, user_id=e59474a509034eb4a89becc3e16c31c2, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.544141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.654937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1284/2568] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:36:57 2022] PUT /identity/v3/projects/625ca7a1c3734d4babebd407aa736387/users/e59474a509034eb4a89becc3e16c31c2/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:36:57.666334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.666632 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.666904 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.692547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] MFA Rules not processed for user `e59474a509034eb4a89becc3e16c31c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:36:57.693729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:57.755229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1285/2569] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:36:57.767282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:36:57.768976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:36:57.824654 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf4f5c-eeed-41b3-a3a0-c7c0654994e9 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:36:57.828311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:36:57.828943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:36:57.829228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:36:57.829497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:36:57.838469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:36:57.839935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:36:57.848517 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1285/2570] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:36:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:00.789865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:00.799678 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e254d72-c95f-4d1e-a4b7-03e5a0643253 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:00.803500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:00.804167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:00.804453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:00.804747 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:00.807073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:00.871584 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:00.873101 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc0b74-ea7b-4cff-b53c-e676ca9e4255 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:00.885029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1286/2571] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:01.912718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:01.979197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0967f-3c47-4c87-9283-83106a14257c service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:01.984493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:01.985354 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:01.985688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:01.986173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] PATH_INFO: `/v3/users/e59474a509034eb4a89becc3e16c31c2` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:01.987601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59474a509034eb4a89becc3e16c31c2)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:01.989553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:02.114555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:02.115011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:02.115125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:02.133820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:02.135026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:02.190637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1287/2572] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:37:02.203530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:02.204899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:02.217714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59474a509034eb4a89becc3e16c31c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:02.230215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59474a509034eb4a89becc3e16c31c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:02.230930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59474a509034eb4a89becc3e16c31c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:02.231559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59474a509034eb4a89becc3e16c31c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:02.277031 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef83e4-3251-4826-a7fe-2f3794e67f24 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:02.282050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:02.282686 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:02.283137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:02.283456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:02.285224 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:02.295639 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:02.297268 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6a08d-0804-4c6d-b014-b9cb37a966c1 service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:02.305943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1288/2573] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 16:37:02.311602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59474a509034eb4a89becc3e16c31c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:02.325524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1286/2574] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:37:01 2022] DELETE /identity/v3/users/e59474a509034eb4a89becc3e16c31c2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:37:02.330041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:02.330332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:02.330608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:02.348129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:02.349304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:02.407767 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1289/2575] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:37:02.417596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:02.419275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:02.482385 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c910cad-9d46-4276-baeb-4045e044fb7c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:02.486465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d2665-3a27-406e-867e-a4bf562726bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:02.487112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2665-3a27-406e-867e-a4bf562726bb service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:02.487512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2665-3a27-406e-867e-a4bf562726bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:02.487793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2665-3a27-406e-867e-a4bf562726bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:02.498392 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2665-3a27-406e-867e-a4bf562726bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:02.500326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2665-3a27-406e-867e-a4bf562726bb service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:02.529417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1287/2576] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:02.982571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:02.982571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:03.004397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be0644-c29d-439e-80ab-f0436972b680 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.010147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.010930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.011827 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.012348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] PATH_INFO: `/v3/projects/625ca7a1c3734d4babebd407aa736387` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.013592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=625ca7a1c3734d4babebd407aa736387)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.015592 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.124591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625ca7a1c3734d4babebd407aa736387', 'request_id': 'req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:03.132143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625ca7a1c3734d4babebd407aa736387', 'request_id': 'req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:03.139644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625ca7a1c3734d4babebd407aa736387', 'request_id': 'req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:03.278776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] The token cache is being invalidate because project 625ca7a1c3734d4babebd407aa736387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:37:03.279071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:03.279783 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-aa67ccb7-ff46-4c35-84a0-a117e2f42f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:03.281362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1290/2577] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:37:02 2022] DELETE /identity/v3/projects/625ca7a1c3734d4babebd407aa736387 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:37:03.286199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.286732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.286965 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.305681 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:03.307046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:03.370718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1288/2578] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:03.378607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.378896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.381148 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.402436 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:03.403874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:03.415481 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1291/2579] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:03.416995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:03.427482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22718b90-259a-4ee0-b1f8-6b0b569ee323 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.432844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.433618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.433963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.434304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.435097 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:37:03.435524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.437165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.451516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1289/2580] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:37:03.455868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:03.466439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58297-9cbb-4c5b-a880-7122689c6c87 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.471174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.471861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.472144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.472416 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.473109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.475058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.580208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1292/2581] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:37:03 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:37:03.581386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:03.596828 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e9948-e920-4966-85ee-8be943a7fafd admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.656925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.657732 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.658083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.658432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.659190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.661303 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.734055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1290/2582] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:37:03 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:37:03.738132 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:03.749521 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0bbf-8340-47ab-8d94-ee7bf15529f5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.754470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.755173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.755485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.755799 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.756546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.759012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.771712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1293/2583] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:37:03.776372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:03.787896 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2d0c-182d-4921-984a-41abffa1f5b7 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.793405 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b73a0c-40ec-4dfe-87ed-9fe032b0046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.794335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73a0c-40ec-4dfe-87ed-9fe032b0046c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.794866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73a0c-40ec-4dfe-87ed-9fe032b0046c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.795352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b73a0c-40ec-4dfe-87ed-9fe032b0046c admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.796267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b73a0c-40ec-4dfe-87ed-9fe032b0046c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.798026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b73a0c-40ec-4dfe-87ed-9fe032b0046c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.811926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1291/2584] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:37:03.818297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:03.829752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7579c8-7ad0-4ef2-bd34-0ec8b3ae8c5b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:03.834580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:03.835756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.836059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:03.836825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] PATH_INFO: `/v3/projects/31d7e14b49a04113b1c756253bd5cb84/users/e4c25429e0bd4c5aa7f5de3e84710c5e/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:03.853945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d7e14b49a04113b1c756253bd5cb84, user_id=e4c25429e0bd4c5aa7f5de3e84710c5e, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:03.856607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:03.997262 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1294/2585] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:37:03 2022] PUT /identity/v3/projects/31d7e14b49a04113b1c756253bd5cb84/users/e4c25429e0bd4c5aa7f5de3e84710c5e/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:37:03.999347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f27af-7188-4d0e-bdcd-5ab3b77aaaec None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:03.999692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f27af-7188-4d0e-bdcd-5ab3b77aaaec None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:04.000044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f27af-7188-4d0e-bdcd-5ab3b77aaaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:04.034687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-038f27af-7188-4d0e-bdcd-5ab3b77aaaec None None] MFA Rules not processed for user `e4c25429e0bd4c5aa7f5de3e84710c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:04.036115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-038f27af-7188-4d0e-bdcd-5ab3b77aaaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:04.119526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1292/2586] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:04.131482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:04.134042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:04.213163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb10277-945c-4dd7-b346-03978290d69d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:04.217296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87983c-94b4-4cf8-8a43-9b5c1f712eca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:04.217945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87983c-94b4-4cf8-8a43-9b5c1f712eca service glance] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:04.218250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87983c-94b4-4cf8-8a43-9b5c1f712eca service glance] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:04.218594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87983c-94b4-4cf8-8a43-9b5c1f712eca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:04.232883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87983c-94b4-4cf8-8a43-9b5c1f712eca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:04.234624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87983c-94b4-4cf8-8a43-9b5c1f712eca service glance] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:04.247158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1295/2587] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:13.814890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b8d05-f6b7-452a-92e5-46bba3b41a33 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:13.815468 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b8d05-f6b7-452a-92e5-46bba3b41a33 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:13.815690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b8d05-f6b7-452a-92e5-46bba3b41a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:13.837023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-171b8d05-f6b7-452a-92e5-46bba3b41a33 None None] MFA Rules not processed for user `fe4733f5e72d4a3ab627a4fd80ee76e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:13.841318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-171b8d05-f6b7-452a-92e5-46bba3b41a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:13.898014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1293/2588] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:24.023275 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebdc9-53b5-4d72-bff8-c21dfe251f22 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.023842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebdc9-53b5-4d72-bff8-c21dfe251f22 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.024690 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ebdc9-53b5-4d72-bff8-c21dfe251f22 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.026455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1296/2589] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:37:24.033134 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e639af-451a-4844-a6ec-78cc190a2681 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.033593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e639af-451a-4844-a6ec-78cc190a2681 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.033703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e639af-451a-4844-a6ec-78cc190a2681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.057021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d1e639af-451a-4844-a6ec-78cc190a2681 None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:24.064870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d1e639af-451a-4844-a6ec-78cc190a2681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:24.162427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1294/2590] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:24.175095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebdc9-53b5-4d72-bff8-c21dfe251f22 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:24.186243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ebdc9-53b5-4d72-bff8-c21dfe251f22 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:24.190016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbd800-01b1-47fb-9d73-38dc8204dccf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0545d7ffc7b84827a5f64629b0e447f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:24.192320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbd800-01b1-47fb-9d73-38dc8204dccf service glance] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.192622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbd800-01b1-47fb-9d73-38dc8204dccf service glance] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.192903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbd800-01b1-47fb-9d73-38dc8204dccf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.204912 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbd800-01b1-47fb-9d73-38dc8204dccf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:24.206469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbd800-01b1-47fb-9d73-38dc8204dccf service glance] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:24.218571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1297/2591] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:24.386771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a5ed-e4c7-4f88-96c3-e5b0beac65c7 None None] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.386990 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a5ed-e4c7-4f88-96c3-e5b0beac65c7 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.387432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a5ed-e4c7-4f88-96c3-e5b0beac65c7 None None] PATH_INFO: `/` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.388910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1295/2592] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:37:24.394168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd241f-412a-497a-a3ed-232371123196 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.394455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd241f-412a-497a-a3ed-232371123196 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.394734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd241f-412a-497a-a3ed-232371123196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.412968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a4fd241f-412a-497a-a3ed-232371123196 None None] MFA Rules not processed for user `79eb9c30fbae438784968a8f770a92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:24.414159 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a4fd241f-412a-497a-a3ed-232371123196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:24.466020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1298/2593] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:24.478503 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a5ed-e4c7-4f88-96c3-e5b0beac65c7 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:24.480188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0527a5ed-e4c7-4f88-96c3-e5b0beac65c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:24.493870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a5ed-e4c7-4f88-96c3-e5b0beac65c7 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:24.498520 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725db08a-b2d1-49ba-ab3a-6a828c712ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:24.499199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725db08a-b2d1-49ba-ab3a-6a828c712ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.499525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725db08a-b2d1-49ba-ab3a-6a828c712ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.499812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725db08a-b2d1-49ba-ab3a-6a828c712ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.511161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725db08a-b2d1-49ba-ab3a-6a828c712ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:24.512652 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725db08a-b2d1-49ba-ab3a-6a828c712ea5 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:24.520943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1296/2594] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:24.604231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5c97-8b1c-4063-8de8-4a374fd45ce8 None None] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.604752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5c97-8b1c-4063-8de8-4a374fd45ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.605068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5c97-8b1c-4063-8de8-4a374fd45ce8 None None] PATH_INFO: `/` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.606478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1299/2595] 10.222.0.42 () {54 vars in 921 bytes} [Tue May 3 16:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 16:37:24.611895 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c659-b7a2-4171-8e01-f8993d56b14b None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.612191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c659-b7a2-4171-8e01-f8993d56b14b None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.612450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214c659-b7a2-4171-8e01-f8993d56b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.633786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c214c659-b7a2-4171-8e01-f8993d56b14b None None] MFA Rules not processed for user `7bc226da24944f578dd20785b5bcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:24.635345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c214c659-b7a2-4171-8e01-f8993d56b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:24.645373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1297/2596] 10.222.0.42 () {58 vars in 1018 bytes} [Tue May 3 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:37:24.656728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e5c97-8b1c-4063-8de8-4a374fd45ce8 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:24.658658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a18e5c97-8b1c-4063-8de8-4a374fd45ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:24.673555 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e5c97-8b1c-4063-8de8-4a374fd45ce8 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:24.678435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:24.679180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:24.679545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:24.679887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:24.690202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:24.691643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:24.702680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1300/2597] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:28.584451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:28.586518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:28.586518 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:28.603701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:28.609171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:28.667202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1298/2598] 10.222.0.42 () {58 vars in 1009 bytes} [Tue May 3 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:28.678208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:28.679645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:28.751927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4273f-fab0-421b-b0a1-dbddd4827d12 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:28.757109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ff5cf-c3a0-4285-8c96-13cf4fa47729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:28.757765 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff5cf-c3a0-4285-8c96-13cf4fa47729 service swift] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:28.758057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff5cf-c3a0-4285-8c96-13cf4fa47729 service swift] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:28.759087 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff5cf-c3a0-4285-8c96-13cf4fa47729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:28.767652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ff5cf-c3a0-4285-8c96-13cf4fa47729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:28.769231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ff5cf-c3a0-4285-8c96-13cf4fa47729 service swift] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:28.777567 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1301/2599] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:37:45.671595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:45.732855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f863373-9f91-47a8-9427-3214fe6ce165 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:45.737414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:45.738275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:45.738554 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:45.738827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] PATH_INFO: `/v3/users/e4c25429e0bd4c5aa7f5de3e84710c5e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:45.740023 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c25429e0bd4c5aa7f5de3e84710c5e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:45.741927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:45.934432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c25429e0bd4c5aa7f5de3e84710c5e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:45.945871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c25429e0bd4c5aa7f5de3e84710c5e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:45.946559 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c25429e0bd4c5aa7f5de3e84710c5e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:45.947178 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c25429e0bd4c5aa7f5de3e84710c5e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.012471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c25429e0bd4c5aa7f5de3e84710c5e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.024570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1299/2600] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:37:45 2022] DELETE /identity/v3/users/e4c25429e0bd4c5aa7f5de3e84710c5e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:37:46.029619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:46.030153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:46.030153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:46.047492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:37:46.048705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:46.107431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1302/2601] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:37:46.117031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:46.118402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:46.175275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c0c1-ef0c-4eaf-ad33-3eda53eb4663 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:46.178938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:46.179592 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:46.179876 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:46.180152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:46.189004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:46.190423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:46.199692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1300/2602] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:37:46.700206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:37:46.701622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:37:46.714977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a07fb1-5310-4b5a-ae97-85f1b741e7be None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:37:46.719763 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:37:46.720630 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:37:46.720917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:37:46.721195 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] PATH_INFO: `/v3/projects/31d7e14b49a04113b1c756253bd5cb84` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:37:46.722388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d7e14b49a04113b1c756253bd5cb84)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:37:46.724346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:37:46.828473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d7e14b49a04113b1c756253bd5cb84', 'request_id': 'req-a8a40409-8482-47cb-b536-d072c963bc89'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.833658 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d7e14b49a04113b1c756253bd5cb84', 'request_id': 'req-a8a40409-8482-47cb-b536-d072c963bc89'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.843426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d7e14b49a04113b1c756253bd5cb84', 'request_id': 'req-a8a40409-8482-47cb-b536-d072c963bc89'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.926311 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] The token cache is being invalidate because project 31d7e14b49a04113b1c756253bd5cb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:37:46.926604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.927219 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:37:46.928798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1303/2603] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:37:46 2022] DELETE /identity/v3/projects/31d7e14b49a04113b1c756253bd5cb84 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:38:06.855477 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:06.857095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:06.867274 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:06.868614 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0c06e-2016-4ce6-803d-52f1319aee7b service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:06.868761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:06.918831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:06.919501 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:06.919786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:06.920062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:06.921963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:06.925360 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a40409-8482-47cb-b536-d072c963bc89 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:06.929140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:06.929788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:06.930088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:06.930373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:06.932169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:06.991908 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:06.993351 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:07.003094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:07.004554 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3d474-14f4-4339-a60f-8476198ce2bd service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:07.006076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1301/2604] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:38:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:38:07.016164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1304/2605] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:38:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:38:11.332543 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:11.341276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63c15-2bd2-45bb-8cf7-162af5952489 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:11.345017 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:11.345651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:11.345933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:11.346209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:11.347963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:11.412419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:11.413861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:11.425856 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1302/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:38:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:38:11.965985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:11.968040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:11.968040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:11.986168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] MFA Rules not processed for user `29989d1545154c4093f9c43c4c7abe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:38:11.993603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:12.041978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1305/2607] 10.222.0.42 () {58 vars in 967 bytes} [Tue May 3 16:38:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:38:12.068564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:12.070117 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:12.142836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f4327-4535-49d4-b4f6-96e8800c1e71 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:12.150403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ccd3c2454f94e998769076fbe20eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:12.151061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:12.151472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:12.151702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:12.162466 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:12.164463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:12.173765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1303/2608] 10.222.0.42 () {60 vars in 1384 bytes} [Tue May 3 16:38:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 16:38:24.492936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:24.503431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c64b1-949a-498c-9bd8-f1163c694ecf None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:24.507000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:24.507682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:24.507968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:24.508244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:24.510041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:24.572594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:24.574113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:24.585134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1306/2609] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:38:28.459242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:28.460793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:28.474822 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c46a47-b23c-4fdd-9512-0fab45adbac2 service swift] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:28.479653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:28.480512 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:28.480790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:28.481064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] PATH_INFO: `/v3/users/bc1eb5755b1549e0b50c6f6a701a0d1c` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:28.495034 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1eb5755b1549e0b50c6f6a701a0d1c)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:28.496977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:28.676698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1eb5755b1549e0b50c6f6a701a0d1c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:28.688148 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1eb5755b1549e0b50c6f6a701a0d1c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:28.688805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1eb5755b1549e0b50c6f6a701a0d1c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:28.689407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1eb5755b1549e0b50c6f6a701a0d1c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:28.743571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ae817872-def7-4a85-96f4-85415a0b633c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1eb5755b1549e0b50c6f6a701a0d1c'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:28.756434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1304/2610] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:38:28 2022] DELETE /identity/v3/users/bc1eb5755b1549e0b50c6f6a701a0d1c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:38:28.979963 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:28.993899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683da75-ed74-42fa-a01a-476a5be142eb service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.057511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.058362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.058644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.058917 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] PATH_INFO: `/v3/projects/6f272be1938043fab0bd96cad1e95e7e` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.069054 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f272be1938043fab0bd96cad1e95e7e)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.070985 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.165478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f272be1938043fab0bd96cad1e95e7e', 'request_id': 'req-64097d20-2554-40df-b50e-dba93be130b1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:29.171741 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f272be1938043fab0bd96cad1e95e7e', 'request_id': 'req-64097d20-2554-40df-b50e-dba93be130b1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:29.178570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f272be1938043fab0bd96cad1e95e7e', 'request_id': 'req-64097d20-2554-40df-b50e-dba93be130b1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:29.279846 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] The token cache is being invalidate because project 6f272be1938043fab0bd96cad1e95e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:38:29.280153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:29.280923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-64097d20-2554-40df-b50e-dba93be130b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:38:29.282544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1307/2611] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:38:28 2022] DELETE /identity/v3/projects/6f272be1938043fab0bd96cad1e95e7e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:38:29.287645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.287960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.288245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.305969 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:38:29.307167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:29.365789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1305/2612] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:38:29.373858 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.374146 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.374422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.392806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:38:29.394040 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:29.401979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1308/2613] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:38:29.406040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:29.415793 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d3051-8933-47f9-ae6d-6b2111419c01 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.420471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.421119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.421403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.421683 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.422406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:38:29.422714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.424870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.436067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1306/2614] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:38:29.440728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:29.449881 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843e847-07fc-41c0-aaa8-b97c1b073e4d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.454507 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.455142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.455482 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.455761 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.456452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.458585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.552032 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1309/2615] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:38:29 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:38:29.556214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:29.566878 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280f28-54df-4e65-8964-5f71e2e77150 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.622353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.623016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.623357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.623640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.624319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.626243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.732206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1307/2616] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:38:29 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:38:29.736559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:29.747676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a7d9-272e-4027-8227-40269a41716d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.752220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.752899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.753504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.753785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.754528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.756128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.766063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1310/2617] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:38:29.770587 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:29.780663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba804fd-2896-475e-bfd0-f8a049aab2c4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.785844 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326b1c3-ba6c-4057-ae29-80d087a0bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.786498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326b1c3-ba6c-4057-ae29-80d087a0bcec admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.786783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326b1c3-ba6c-4057-ae29-80d087a0bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.787062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326b1c3-ba6c-4057-ae29-80d087a0bcec admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.787817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326b1c3-ba6c-4057-ae29-80d087a0bcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.789432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326b1c3-ba6c-4057-ae29-80d087a0bcec admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.799399 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1308/2618] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:38:29.804000 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:29.813868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea768e-7828-456f-9489-45612ecba244 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:29.818557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:29.819459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.819745 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.820016 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] PATH_INFO: `/v3/projects/a4383f0fac024017990e15931cae0eaf/users/986476f3c27b4870bf6f902e8731bb79/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.834833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4383f0fac024017990e15931cae0eaf, user_id=986476f3c27b4870bf6f902e8731bb79, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:29.837514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:29.932617 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1311/2619] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:38:29 2022] PUT /identity/v3/projects/a4383f0fac024017990e15931cae0eaf/users/986476f3c27b4870bf6f902e8731bb79/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:38:29.943692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:29.944014 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:29.944294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:29.970211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] MFA Rules not processed for user `986476f3c27b4870bf6f902e8731bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:38:29.972026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:30.034236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1309/2620] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:38:30.038599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.100679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f17c-f8e3-4575-823e-b5c9b4ef3486 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.105178 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.105833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.106119 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.106442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.107123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.109064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.185418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1312/2621] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:38:30 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:38:30.191064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.200421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197a0a6-bd4f-4832-9123-a9a43c45f9e4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.256098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.256753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.257032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.257304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.258000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.260234 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.372657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1310/2622] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:38:30 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:38:30.376174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.387065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bec0a-149d-4b0f-bba2-e5bc8e6b4d19 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.392329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.393689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.393978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.394256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.394984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.396607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.407527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1313/2623] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:38:30.411867 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.422109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668609-1ead-4c3b-9aeb-bbbfff789e10 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.427050 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.428003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.428282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.428553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] PATH_INFO: `/v3/projects/2b9851d929364d96a37581a5274dbfa9/users/44163abe84684a029a82efd255790492/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.443491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9851d929364d96a37581a5274dbfa9, user_id=44163abe84684a029a82efd255790492, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.446112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.549326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1311/2624] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:38:30 2022] PUT /identity/v3/projects/2b9851d929364d96a37581a5274dbfa9/users/44163abe84684a029a82efd255790492/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:38:30.553241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.563437 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97d83-1829-48a2-a25c-9bc48c5ba3cd admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.618691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45744e-1126-465f-8dae-db8d04cda2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.619377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45744e-1126-465f-8dae-db8d04cda2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.619664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45744e-1126-465f-8dae-db8d04cda2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.619947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45744e-1126-465f-8dae-db8d04cda2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.620667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45744e-1126-465f-8dae-db8d04cda2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.622259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45744e-1126-465f-8dae-db8d04cda2a1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.632362 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1314/2625] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:38:30.636335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.647331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e84d-6bb5-46a5-bb84-7da0b97e2935 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.651929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.652805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.653089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.653362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] PATH_INFO: `/v3/projects/2b9851d929364d96a37581a5274dbfa9/users/44163abe84684a029a82efd255790492/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.655362 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9851d929364d96a37581a5274dbfa9, user_id=44163abe84684a029a82efd255790492, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.658042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.667982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1312/2626] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:38:30 2022] PUT /identity/v3/projects/2b9851d929364d96a37581a5274dbfa9/users/44163abe84684a029a82efd255790492/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:38:30.678097 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.685288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.685288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.705166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] MFA Rules not processed for user `44163abe84684a029a82efd255790492`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:38:30.706647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:30.774970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1315/2627] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:38:30.787492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:30.789175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:38:30.847280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b9082-3435-4e57-af28-9735927af26a admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:30.850907 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:30.851567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:30.851851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:30.852132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:30.860958 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:30.862819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:30.872297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1313/2628] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:38:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:38:31.069269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:38:31.078746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dede3-a646-479a-a5d6-ae51612bac93 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:38:31.082806 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:38:31.083715 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:38:31.084001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:38:31.084280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:38:31.139099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:38:31.140557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:38:31.150039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1316/2629] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:38:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:15.984492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:15.985953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:16.041133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26302df9-4032-4da9-84b1-d08ac375e1b9 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:16.044696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:16.045324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:16.045601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:16.045870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:16.047604 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:16.057071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:16.058473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714c000-32f2-4768-a0e9-62ba6cb5295b service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:16.066271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1314/2630] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:25.563314 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:25.628168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605122-09f6-470a-b39f-046b1ec42aa2 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:25.633803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:25.634713 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:25.634990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:25.635276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] PATH_INFO: `/v3/users/986476f3c27b4870bf6f902e8731bb79` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:25.636500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986476f3c27b4870bf6f902e8731bb79)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:25.638403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:25.827676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986476f3c27b4870bf6f902e8731bb79'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:25.834469 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986476f3c27b4870bf6f902e8731bb79'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:25.835916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986476f3c27b4870bf6f902e8731bb79'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:25.836651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986476f3c27b4870bf6f902e8731bb79'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:25.847966 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986476f3c27b4870bf6f902e8731bb79'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:25.936188 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1317/2631] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:25 2022] DELETE /identity/v3/users/986476f3c27b4870bf6f902e8731bb79 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:25.940650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:25.941111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:25.941226 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:25.957982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:25.959150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:26.015912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1315/2632] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:26.026055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:26.027504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:26.083559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2f9d-b95f-4189-a560-1eb3a5b2a9d4 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:26.088065 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:26.088696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:26.088982 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:26.089247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:26.097852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:26.099277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:26.109052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1318/2633] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:39:26.527114 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:26.528579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:26.541070 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f024dc3-4cb8-4971-9565-92e7d09bb0d8 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:26.546473 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:26.547363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:26.547674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:26.547950 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] PATH_INFO: `/v3/projects/a4383f0fac024017990e15931cae0eaf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:26.549163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4383f0fac024017990e15931cae0eaf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:26.551067 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:26.651993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4383f0fac024017990e15931cae0eaf', 'request_id': 'req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:26.730771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4383f0fac024017990e15931cae0eaf', 'request_id': 'req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:26.736357 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4383f0fac024017990e15931cae0eaf', 'request_id': 'req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:26.747696 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] The token cache is being invalidate because project a4383f0fac024017990e15931cae0eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:26.747995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:26.748608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:26.750152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1316/2634] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:26 2022] DELETE /identity/v3/projects/a4383f0fac024017990e15931cae0eaf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:26.754123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:26.764712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bd26c-5027-4f99-84cf-08b2e8270885 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:26.822176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:26.823052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:26.823373 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:26.823652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] PATH_INFO: `/v3/users/44163abe84684a029a82efd255790492` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:26.824841 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44163abe84684a029a82efd255790492)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:26.826753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:27.044609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44163abe84684a029a82efd255790492'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.051171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44163abe84684a029a82efd255790492'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.055235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44163abe84684a029a82efd255790492'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.055235 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44163abe84684a029a82efd255790492'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.064377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2cec1690-9caf-493b-852e-aa13c476de49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44163abe84684a029a82efd255790492'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.153530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1319/2635] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:26 2022] DELETE /identity/v3/users/44163abe84684a029a82efd255790492 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:27.584374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:27.586414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:27.599568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9abd5f-b49e-4e0c-84a3-aef481dd3997 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:27.660055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:27.660930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:27.661253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:27.661526 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] PATH_INFO: `/v3/projects/2b9851d929364d96a37581a5274dbfa9` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:27.662697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9851d929364d96a37581a5274dbfa9)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:27.665026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:27.793282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9851d929364d96a37581a5274dbfa9', 'request_id': 'req-27025ed8-d674-41f5-910b-5fa1f7fefbf8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.907893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9851d929364d96a37581a5274dbfa9', 'request_id': 'req-27025ed8-d674-41f5-910b-5fa1f7fefbf8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.913563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9851d929364d96a37581a5274dbfa9', 'request_id': 'req-27025ed8-d674-41f5-910b-5fa1f7fefbf8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.924830 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] The token cache is being invalidate because project 2b9851d929364d96a37581a5274dbfa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:27.925116 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.925736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-27025ed8-d674-41f5-910b-5fa1f7fefbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:27.927341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1317/2636] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:27 2022] DELETE /identity/v3/projects/2b9851d929364d96a37581a5274dbfa9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:27.932260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:27.932786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:27.932902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:27.952010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:27.953257 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:28.013246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1320/2637] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:28.021004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.021291 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.021571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.039726 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:28.040911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:28.048758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1318/2638] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:28.058835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.068302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef32e5-d5d9-4e65-a0a6-9b991c94c057 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.073776 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.074420 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.074701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.074976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.075721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:39:28.076025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.077602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.089543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1321/2639] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:39:28.093761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.103174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2ff58-519a-43b9-abb9-9a6181371da6 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.111158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.112409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.112705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.112988 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.113680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.117817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.201248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1319/2640] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:28 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:28.205443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.215743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdfe92-bdf0-452f-b80e-bf51a9c7d52c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.270933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.271623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.271908 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.272184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.272857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.274862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.354243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1322/2641] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:28 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:28.358497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.369545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48777f06-27dc-44df-8d32-9b7c03253a4f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.374423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.375166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.375567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.376091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.378125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.379766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.390552 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1320/2642] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:28.394384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.411173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30778c-6215-4056-b212-86b3d65afb38 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.417002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983460b-4b6f-4eab-a0df-b14cc7444899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.417667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983460b-4b6f-4eab-a0df-b14cc7444899 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.417953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983460b-4b6f-4eab-a0df-b14cc7444899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.418232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983460b-4b6f-4eab-a0df-b14cc7444899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.418959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983460b-4b6f-4eab-a0df-b14cc7444899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.420637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983460b-4b6f-4eab-a0df-b14cc7444899 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.431737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1323/2643] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:28.435928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.445981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ce92-9e90-4a72-9b14-509e1c6cd80f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.450688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.451529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.451814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.452089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] PATH_INFO: `/v3/projects/12f055083f064290aa23649808c97408/users/4ab6eba5c14344fd9dc1037b16f9e1ca/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.466256 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f055083f064290aa23649808c97408, user_id=4ab6eba5c14344fd9dc1037b16f9e1ca, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.468938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.543150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1321/2644] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:28 2022] PUT /identity/v3/projects/12f055083f064290aa23649808c97408/users/4ab6eba5c14344fd9dc1037b16f9e1ca/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:28.553589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.553890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.554174 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.581112 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] MFA Rules not processed for user `4ab6eba5c14344fd9dc1037b16f9e1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:28.582569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:28.646989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1324/2645] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:28.651687 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.712453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99091aa-eec8-44b2-8586-7c702deb0c71 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.719773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.722841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.723136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.723438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.724142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.728531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:28.850035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1322/2646] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:28 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:28.854694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:28.865560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280905d2-231c-4155-b03a-24c0172e56e5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:28.921244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:28.921905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:28.922187 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:28.922464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:28.923151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:28.925142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:29.033473 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1325/2647] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:28 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:29.037394 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:29.048788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55fc42-a8a4-4d97-9acf-45344b466cdf admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:29.053509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:29.054156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:29.054434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:29.055147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:29.055918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:29.057502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:29.067942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1323/2648] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:29.071937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:29.081809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673fb07-f411-40cd-af05-ae65d1f7e7c8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:29.086805 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:29.087720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:29.088046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:29.088341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] PATH_INFO: `/v3/projects/0c784a8f2a994ba186183425246ae14f/users/8de5e62233b14d5e919836fcdc3690f6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:29.104845 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c784a8f2a994ba186183425246ae14f, user_id=8de5e62233b14d5e919836fcdc3690f6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:29.108886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:29.185020 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1326/2649] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:29 2022] PUT /identity/v3/projects/0c784a8f2a994ba186183425246ae14f/users/8de5e62233b14d5e919836fcdc3690f6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:29.189002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:29.200015 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1a1f-c55c-4dc6-ab63-1c2030f4d120 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:29.255371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd8c7d-4cd3-4e96-96c0-de6a99001f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:29.256025 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8c7d-4cd3-4e96-96c0-de6a99001f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:29.256310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8c7d-4cd3-4e96-96c0-de6a99001f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:29.256588 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8c7d-4cd3-4e96-96c0-de6a99001f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:29.257297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd8c7d-4cd3-4e96-96c0-de6a99001f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:29.259699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd8c7d-4cd3-4e96-96c0-de6a99001f68 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:29.269156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1324/2650] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:29.274736 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:29.287407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a831c0-b057-4eb6-b63e-2421a7b3e304 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:29.293653 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:29.294837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:29.295347 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:29.295794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] PATH_INFO: `/v3/projects/0c784a8f2a994ba186183425246ae14f/users/8de5e62233b14d5e919836fcdc3690f6/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:29.298808 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c784a8f2a994ba186183425246ae14f, user_id=8de5e62233b14d5e919836fcdc3690f6, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:29.302953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:29.315184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1327/2651] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:29 2022] PUT /identity/v3/projects/0c784a8f2a994ba186183425246ae14f/users/8de5e62233b14d5e919836fcdc3690f6/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:29.326806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:29.327095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:29.327406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:29.355373 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] MFA Rules not processed for user `8de5e62233b14d5e919836fcdc3690f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:29.356577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:29.423452 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1325/2652] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:29.434455 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:29.436186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:29.495243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba9a2-e084-4fbb-a046-3184611a5571 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:29.498921 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f4e35-48e5-48d3-a366-9e4e05e61ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:29.499585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4e35-48e5-48d3-a366-9e4e05e61ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:29.499870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4e35-48e5-48d3-a366-9e4e05e61ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:29.500149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4e35-48e5-48d3-a366-9e4e05e61ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:29.510254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f4e35-48e5-48d3-a366-9e4e05e61ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:29.511716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f4e35-48e5-48d3-a366-9e4e05e61ae8 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:29.521126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1328/2653] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:30.433106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:30.496087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665cddd-033c-4798-99b8-1b7f2e25b348 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:30.500758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:30.501630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:30.501911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:30.502183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] PATH_INFO: `/v3/users/4ab6eba5c14344fd9dc1037b16f9e1ca` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:30.503422 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab6eba5c14344fd9dc1037b16f9e1ca)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:30.505350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:30.721010 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab6eba5c14344fd9dc1037b16f9e1ca'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:30.732532 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab6eba5c14344fd9dc1037b16f9e1ca'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:30.733203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab6eba5c14344fd9dc1037b16f9e1ca'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:30.733811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab6eba5c14344fd9dc1037b16f9e1ca'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:30.816629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab6eba5c14344fd9dc1037b16f9e1ca'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:30.829285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1326/2654] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:30 2022] DELETE /identity/v3/users/4ab6eba5c14344fd9dc1037b16f9e1ca => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:30.834013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:30.834478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:30.834574 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:30.852220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:30.853406 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:30.910789 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1329/2655] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:30.920931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:30.922322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:30.978106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ceeb-60fb-41d9-8562-3239c04babf5 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:30.981634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:30.982270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:30.982554 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:30.982832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:30.992739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:30.994178 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:31.004047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1327/2656] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:31.401185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:31.402615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:31.417558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7eac8-4679-4203-94d7-2a464b753e88 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:31.422992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:31.424343 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:31.424501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:31.424780 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] PATH_INFO: `/v3/projects/12f055083f064290aa23649808c97408` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:31.425950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f055083f064290aa23649808c97408)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:31.427886 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:31.549289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f055083f064290aa23649808c97408', 'request_id': 'req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.556034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f055083f064290aa23649808c97408', 'request_id': 'req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.564205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f055083f064290aa23649808c97408', 'request_id': 'req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.647995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] The token cache is being invalidate because project 12f055083f064290aa23649808c97408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:31.648365 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.649094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.650663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1330/2657] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:31 2022] DELETE /identity/v3/projects/12f055083f064290aa23649808c97408 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:31.654855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:31.665367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc127f1-ad49-4b97-94ae-c94f71dba85c service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:31.721428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:31.722294 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:31.722578 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:31.722855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] PATH_INFO: `/v3/users/8de5e62233b14d5e919836fcdc3690f6` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:31.724068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de5e62233b14d5e919836fcdc3690f6)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:31.726016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:31.880942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de5e62233b14d5e919836fcdc3690f6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.892671 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de5e62233b14d5e919836fcdc3690f6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.893347 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de5e62233b14d5e919836fcdc3690f6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.893944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de5e62233b14d5e919836fcdc3690f6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.971135 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-b05bd1b9-446c-48a3-96ec-6e67503fe13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de5e62233b14d5e919836fcdc3690f6'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:31.984326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1328/2658] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:31 2022] DELETE /identity/v3/users/8de5e62233b14d5e919836fcdc3690f6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:32.406318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:32.411542 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:32.421850 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153444a-4c45-4a29-9b5b-3bb6ef17a04e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:32.478281 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:32.479197 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:32.479508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:32.479787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] PATH_INFO: `/v3/projects/0c784a8f2a994ba186183425246ae14f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:32.480943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c784a8f2a994ba186183425246ae14f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:32.482818 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:32.576725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c784a8f2a994ba186183425246ae14f', 'request_id': 'req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:32.582237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c784a8f2a994ba186183425246ae14f', 'request_id': 'req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:32.588494 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c784a8f2a994ba186183425246ae14f', 'request_id': 'req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:32.647701 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] The token cache is being invalidate because project 0c784a8f2a994ba186183425246ae14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:32.647991 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:32.648618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0e83b3d-eb0e-467f-a1df-bfe5bcacff42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:32.650202 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1331/2659] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:32 2022] DELETE /identity/v3/projects/0c784a8f2a994ba186183425246ae14f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:32.655078 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:32.655589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:32.655699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:32.672912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:32.674123 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:32.732098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1329/2660] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:32.739796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:32.740082 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:32.740356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:32.759454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:32.760632 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:32.768952 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1332/2661] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:32.772891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:32.785688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa78014-aba3-405b-b66a-03ae2e4d5039 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:32.790821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:32.791923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:32.791923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:32.792149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:32.792805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:39:32.793111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:32.794712 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:32.807092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1330/2662] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:39:32.819596 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:32.829273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd79b-5058-4245-893b-9e88240a777b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:32.834225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:32.834865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:32.835147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:32.835450 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:32.836185 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:32.838053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:32.938449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1333/2663] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:32 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:32.942440 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:32.952600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24391c-38b7-48cd-b8d0-1123f3b34c07 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.007087 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.007899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.008340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.008619 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.009304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.011199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.090957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1331/2664] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:32 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:33.095026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.106321 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccde8e-3536-454b-96e9-5198f077b6ad admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.111033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.111721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.112029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.112284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.113006 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.114597 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.126753 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1334/2665] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:33.130499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.140945 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acbfd-f4d7-450c-83ab-de26c6f6496e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.145636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c074829-150b-4509-aa2a-b33998e30b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.146295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c074829-150b-4509-aa2a-b33998e30b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.146577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c074829-150b-4509-aa2a-b33998e30b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.146851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c074829-150b-4509-aa2a-b33998e30b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.147688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c074829-150b-4509-aa2a-b33998e30b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.149384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c074829-150b-4509-aa2a-b33998e30b6d admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.159622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1332/2666] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:33.164415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.174557 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf92b2-956a-4ede-971c-98a52eed0997 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.180896 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.181790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.182104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.183743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] PATH_INFO: `/v3/projects/a999b701c42645179c615ea725f4217e/users/43e2ec059e1d418faf14bea336a8c923/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.197976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a999b701c42645179c615ea725f4217e, user_id=43e2ec059e1d418faf14bea336a8c923, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.200837 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.289874 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1335/2667] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:33 2022] PUT /identity/v3/projects/a999b701c42645179c615ea725f4217e/users/43e2ec059e1d418faf14bea336a8c923/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:33.302006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.302307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.302589 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.328425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] MFA Rules not processed for user `43e2ec059e1d418faf14bea336a8c923`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:33.329624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:33.391729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1333/2668] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:33.396269 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.457452 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de59c80-4011-439c-9c98-a87f0b9950ff admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.462979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.463681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.463971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.464253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.464945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.466843 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.559778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1336/2669] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:33 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:33.563866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.574657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494a12-ad00-4740-bba5-0994a0d53ac4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.629612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.630267 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.630546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.630819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.631533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.634263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.712785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1334/2670] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:33 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:33.716694 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.728954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78e0d-7eff-488a-9c64-ae8f67ee97b7 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.733674 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.734327 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.734609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.734887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.735666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.737248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.747943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1337/2671] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:39:33.752253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.763064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f336b6-bf01-4c76-853f-e062ff638922 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.767756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.768644 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.768923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.769196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] PATH_INFO: `/v3/projects/6cb99a59d3ee4b608b4389e426d4c62d/users/11e460eaea9f4bcb8e388f1918b8026f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.785636 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb99a59d3ee4b608b4389e426d4c62d, user_id=11e460eaea9f4bcb8e388f1918b8026f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.788389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.862642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1335/2672] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:33 2022] PUT /identity/v3/projects/6cb99a59d3ee4b608b4389e426d4c62d/users/11e460eaea9f4bcb8e388f1918b8026f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:39:33.866958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.877042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a1737-6b48-4932-8578-86f04f354a40 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.932134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d974-ceff-4cd0-8c6d-8a8090824103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.932802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d974-ceff-4cd0-8c6d-8a8090824103 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.933089 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d974-ceff-4cd0-8c6d-8a8090824103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.933369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d974-ceff-4cd0-8c6d-8a8090824103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.934094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08d974-ceff-4cd0-8c6d-8a8090824103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.935730 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08d974-ceff-4cd0-8c6d-8a8090824103 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.946056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1338/2673] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:33.950203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:33.961343 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308864e-b254-4564-98e3-6d3d809da8b1 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:33.966030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:33.966841 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.967121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.967427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] PATH_INFO: `/v3/projects/6cb99a59d3ee4b608b4389e426d4c62d/users/11e460eaea9f4bcb8e388f1918b8026f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:33.969384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb99a59d3ee4b608b4389e426d4c62d, user_id=11e460eaea9f4bcb8e388f1918b8026f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:33.972037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:33.982489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1336/2674] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:33 2022] PUT /identity/v3/projects/6cb99a59d3ee4b608b4389e426d4c62d/users/11e460eaea9f4bcb8e388f1918b8026f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:39:33.994116 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:33.994417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:33.994699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:34.023588 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] MFA Rules not processed for user `11e460eaea9f4bcb8e388f1918b8026f`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:34.024836 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:34.092606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1339/2675] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:34.104237 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:34.105923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:34.164897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04d14-9872-47fd-979b-3aa8982f8af6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:34.168629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:34.169309 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:34.169590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:34.169898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:34.179928 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:34.181508 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:34.191833 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1337/2676] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:34.374414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:34.385260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de31637-d866-4bc3-bb0f-3a0a12e14c5b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:34.389053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:34.389743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:34.390053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:34.391422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:34.456300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:34.458670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:34.469052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1340/2677] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:34.800811 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:34.802345 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:34.922827 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73335-a564-4952-aeb6-1d613cd930b9 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:34.929048 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:34.929922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:34.930289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:34.930590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:34.932521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:34.946220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:34.947963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09963d-b763-409d-a0e0-080ec29f5d31 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:34.961528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1338/2678] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:37.933599 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:37.995531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c66903-5b29-4c43-bca4-a04b8b7f0dc3 service cinder] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:38.000098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:38.000980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:38.001261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:38.001538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] PATH_INFO: `/v3/users/43e2ec059e1d418faf14bea336a8c923` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:38.002759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e2ec059e1d418faf14bea336a8c923)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:38.004729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:38.176208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e2ec059e1d418faf14bea336a8c923'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:38.183009 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e2ec059e1d418faf14bea336a8c923'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:38.183692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e2ec059e1d418faf14bea336a8c923'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:38.184287 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e2ec059e1d418faf14bea336a8c923'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:38.196153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e2ec059e1d418faf14bea336a8c923'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:38.284997 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1341/2679] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:37 2022] DELETE /identity/v3/users/43e2ec059e1d418faf14bea336a8c923 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:38.289747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:38.291043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:38.291043 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:38.307214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:38.308454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:38.366675 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1339/2680] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:38.376474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:38.377872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:38.434319 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82b99-0f7d-4f72-9f86-e88802f9f0aa admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:38.437945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:38.438578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:38.438862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:38.439141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:38.448562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:38.449979 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:38.461046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1342/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:38.863860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:38.865825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:38.889523 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a678d2a-cfa7-4f54-ba0c-5e9fc54d4f09 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:38.897785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:38.897785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:38.897785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:38.897785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] PATH_INFO: `/v3/projects/a999b701c42645179c615ea725f4217e` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:38.898533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a999b701c42645179c615ea725f4217e)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:38.900163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:39.014205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a999b701c42645179c615ea725f4217e', 'request_id': 'req-df2611ba-5f2b-416a-a86c-c409d50ac681'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.082839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a999b701c42645179c615ea725f4217e', 'request_id': 'req-df2611ba-5f2b-416a-a86c-c409d50ac681'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.089028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a999b701c42645179c615ea725f4217e', 'request_id': 'req-df2611ba-5f2b-416a-a86c-c409d50ac681'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.099920 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] The token cache is being invalidate because project a999b701c42645179c615ea725f4217e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:39.100211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.101332 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.103035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1340/2682] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:38 2022] DELETE /identity/v3/projects/a999b701c42645179c615ea725f4217e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:39.106988 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:39.117211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ce1b0-7028-4bf2-b82d-41498bf75c9d service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:39.174264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:39.175140 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:39.175454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:39.175731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] PATH_INFO: `/v3/users/11e460eaea9f4bcb8e388f1918b8026f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:39.176907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e460eaea9f4bcb8e388f1918b8026f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:39.178853 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:39.384136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e460eaea9f4bcb8e388f1918b8026f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.390993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e460eaea9f4bcb8e388f1918b8026f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.391781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e460eaea9f4bcb8e388f1918b8026f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.392389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e460eaea9f4bcb8e388f1918b8026f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.405213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e460eaea9f4bcb8e388f1918b8026f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:39.544397 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1343/2683] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:39 2022] DELETE /identity/v3/users/11e460eaea9f4bcb8e388f1918b8026f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:39.941430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:39.949780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:39.957202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2611ba-5f2b-416a-a86c-c409d50ac681 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.014254 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.015100 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.015415 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.015689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] PATH_INFO: `/v3/projects/6cb99a59d3ee4b608b4389e426d4c62d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.016845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb99a59d3ee4b608b4389e426d4c62d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.018817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.136171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb99a59d3ee4b608b4389e426d4c62d', 'request_id': 'req-602ec040-c425-4c9f-abad-44cbe07a4e2a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:40.174967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.176394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:40.208817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb99a59d3ee4b608b4389e426d4c62d', 'request_id': 'req-602ec040-c425-4c9f-abad-44cbe07a4e2a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:40.214790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb99a59d3ee4b608b4389e426d4c62d', 'request_id': 'req-602ec040-c425-4c9f-abad-44cbe07a4e2a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:40.225792 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] The token cache is being invalidate because project 6cb99a59d3ee4b608b4389e426d4c62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:40.226082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:40.226904 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-602ec040-c425-4c9f-abad-44cbe07a4e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:40.228691 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1341/2684] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:39 2022] DELETE /identity/v3/projects/6cb99a59d3ee4b608b4389e426d4c62d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:40.234220 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f583-c4f1-4ed3-8f7a-323c933cf572 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.234886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216c2ad-c3bf-4581-91d7-f787549ac545 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.235245 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216c2ad-c3bf-4581-91d7-f787549ac545 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.235622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216c2ad-c3bf-4581-91d7-f787549ac545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.254437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f216c2ad-c3bf-4581-91d7-f787549ac545 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:40.255711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f216c2ad-c3bf-4581-91d7-f787549ac545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:40.283932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.284696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.285001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.285276 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.287017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:40.314222 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1342/2685] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:40.322832 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.323129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.323459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.341428 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:40.342662 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:40.350290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.350539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1343/2686] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:40.352940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.355201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.362740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1344/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:39:40.363876 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7859-ec51-42a6-9fdc-8efb1a351a5e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.369233 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.369882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.370167 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.370449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.371180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:39:40.371525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.373121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.384993 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1344/2688] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:39:40.389261 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.399306 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e583bc-6ff9-4402-9107-7d3430fe858f service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.404038 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.404689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.404973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.405250 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.405944 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.407888 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.521994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1345/2689] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:40 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:40.526011 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.539778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce216b-d5a7-46cc-bf73-baca86cabd0c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.599487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.600163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.600443 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.600716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.602509 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.604467 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.722145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1345/2690] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:40 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:40.723425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.734172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92492d-9feb-4bb0-81bc-6b4d2348e5c3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.738729 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.739439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.739723 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.740004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.740739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.742600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.753778 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1346/2691] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:40.757940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.767953 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c98e-1ca5-4bdd-ab1a-07e375f517e2 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.772510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d0ad-9d00-49d6-a29b-a81d00742cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.774318 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d0ad-9d00-49d6-a29b-a81d00742cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.774607 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d0ad-9d00-49d6-a29b-a81d00742cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.774888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d0ad-9d00-49d6-a29b-a81d00742cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.775651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536d0ad-9d00-49d6-a29b-a81d00742cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.777246 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536d0ad-9d00-49d6-a29b-a81d00742cc6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.786983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1346/2692] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:40.791838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:40.801961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fb88b-b1ac-4e56-afa3-2ca9d4c60dd0 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:40.807356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:40.808240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.808523 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.808801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] PATH_INFO: `/v3/projects/bd2d79f4596948ddb7d1e9ee23135019/users/02def622a6ff43928c228281f1ce9f4d/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.823851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d79f4596948ddb7d1e9ee23135019, user_id=02def622a6ff43928c228281f1ce9f4d, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:40.826502 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:40.903409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1347/2693] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:40 2022] PUT /identity/v3/projects/bd2d79f4596948ddb7d1e9ee23135019/users/02def622a6ff43928c228281f1ce9f4d/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:40.915561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:40.915850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:40.916126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:40.942650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] MFA Rules not processed for user `02def622a6ff43928c228281f1ce9f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:40.943898 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:41.009760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1347/2694] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:41.021289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:41.023571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:41.078852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a944f5b-4fb6-419f-8535-9f0218dbcfb5 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:41.082848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21cb8b-dd74-421b-b265-1a49f7dc5d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:41.083514 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21cb8b-dd74-421b-b265-1a49f7dc5d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:41.083803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21cb8b-dd74-421b-b265-1a49f7dc5d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:41.084084 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21cb8b-dd74-421b-b265-1a49f7dc5d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:41.092978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21cb8b-dd74-421b-b265-1a49f7dc5d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:41.094419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21cb8b-dd74-421b-b265-1a49f7dc5d51 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:41.104109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1348/2695] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:41.123028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:41.186329 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ced09-3827-4123-9139-9e7aa0b03e7c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:41.191066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:41.191963 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:41.192369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:41.192649 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] PATH_INFO: `/v3/users/02def622a6ff43928c228281f1ce9f4d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:41.193859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02def622a6ff43928c228281f1ce9f4d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:41.196406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:41.428154 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02def622a6ff43928c228281f1ce9f4d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:41.440865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02def622a6ff43928c228281f1ce9f4d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:41.441939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02def622a6ff43928c228281f1ce9f4d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:41.442629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02def622a6ff43928c228281f1ce9f4d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:41.508065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02def622a6ff43928c228281f1ce9f4d'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:41.521999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1348/2696] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:41 2022] DELETE /identity/v3/users/02def622a6ff43928c228281f1ce9f4d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:41.527213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:41.527737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:41.527835 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:41.546459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:41.547826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:41.609947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1349/2697] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:41.619472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:41.620960 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:41.677938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab78b4-c905-4eaf-9286-aafb8e280571 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:41.681692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca22f9-9ee3-4b15-8650-ae79aa5cef38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:41.682339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca22f9-9ee3-4b15-8650-ae79aa5cef38 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:41.682624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca22f9-9ee3-4b15-8650-ae79aa5cef38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:41.682900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca22f9-9ee3-4b15-8650-ae79aa5cef38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:41.692089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca22f9-9ee3-4b15-8650-ae79aa5cef38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:41.693524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca22f9-9ee3-4b15-8650-ae79aa5cef38 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:41.703314 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1349/2698] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:39:42.098885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.100621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:42.113737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee1fe0-c2dc-4e1a-8e56-3dc234b80531 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.118676 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.119573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.119852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.120135 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] PATH_INFO: `/v3/projects/bd2d79f4596948ddb7d1e9ee23135019` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.121331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2d79f4596948ddb7d1e9ee23135019)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.123543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:42.268825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2d79f4596948ddb7d1e9ee23135019', 'request_id': 'req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:42.275607 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2d79f4596948ddb7d1e9ee23135019', 'request_id': 'req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:42.284237 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2d79f4596948ddb7d1e9ee23135019', 'request_id': 'req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:42.370332 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] The token cache is being invalidate because project bd2d79f4596948ddb7d1e9ee23135019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:42.370865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:42.372127 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-25c908bc-47b7-4f7a-87b1-c0e8f87a9c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:42.374937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1350/2699] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:42 2022] DELETE /identity/v3/projects/bd2d79f4596948ddb7d1e9ee23135019 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:42.380331 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.381202 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.381639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.411131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:42.412446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:42.490653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1350/2700] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:42.499080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.499425 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.499714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.524162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:42.525381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:42.533585 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1351/2701] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:42.540046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.550600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2b318-f799-46b7-bad6-25f5295db87d None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.556342 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.557540 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.558112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.559138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.559138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:39:42.559459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.561079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:42.574825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1351/2702] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:39:42.579149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.589378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efa92e-093a-4347-a944-a6c04e876204 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.594318 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.594992 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.595293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.595578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.596302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.598239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:42.682246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1352/2703] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:42 2022] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:42.686537 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.696985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a215d-7e71-49b6-b565-ad7cd4de76bf admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.758153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.758966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.759425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.759767 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.760909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.762582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:42.846450 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1352/2704] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:42 2022] POST /identity/v3/users => generated 281 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:42.852117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.865508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194e763-25e5-4b9f-ad33-64479b226f55 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.872794 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.874499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.874499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.874499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.874885 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.876414 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:42.888461 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1353/2705] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:42.892476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.903594 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95005-a085-428c-8a0f-07e3f62d91cc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.910197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b79ff8-a9b6-415a-8de1-2996c7f9b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.911199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79ff8-a9b6-415a-8de1-2996c7f9b255 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.911750 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79ff8-a9b6-415a-8de1-2996c7f9b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.912220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79ff8-a9b6-415a-8de1-2996c7f9b255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.914111 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b79ff8-a9b6-415a-8de1-2996c7f9b255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.916927 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b79ff8-a9b6-415a-8de1-2996c7f9b255 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:42.927556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1353/2706] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:39:42.932477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:42.942953 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cb5a0-890f-4fe6-b774-6bc68babcfce admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:42.948449 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:42.949345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:42.949628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:42.949907 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] PATH_INFO: `/v3/projects/c9c22283bc0b41a69eb4ab3bbafc536d/users/0d4b0226feb2406193ebace5b9fb3672/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:42.969540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c22283bc0b41a69eb4ab3bbafc536d, user_id=0d4b0226feb2406193ebace5b9fb3672, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:42.972316 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:43.037403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1354/2707] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:42 2022] PUT /identity/v3/projects/c9c22283bc0b41a69eb4ab3bbafc536d/users/0d4b0226feb2406193ebace5b9fb3672/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:39:43.048690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:43.049105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:43.049408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:43.083349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] MFA Rules not processed for user `0d4b0226feb2406193ebace5b9fb3672`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:43.084583 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:43.149658 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1354/2708] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:43.184029 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:43.185977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:43.260517 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a0219-8a3c-456d-9a2c-3470d94a6ca6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:43.268334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7774979-d684-46f6-88f4-0d887c5b9bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:43.268334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774979-d684-46f6-88f4-0d887c5b9bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:43.268334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774979-d684-46f6-88f4-0d887c5b9bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:43.268334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774979-d684-46f6-88f4-0d887c5b9bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:43.277711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7774979-d684-46f6-88f4-0d887c5b9bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:43.279293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7774979-d684-46f6-88f4-0d887c5b9bcd service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:43.290153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1355/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:43.314556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:43.391759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a527e-4754-46ef-8e39-6d1b69b8301f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:43.398685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:43.399612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:43.400161 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:43.400447 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] PATH_INFO: `/v3/users/0d4b0226feb2406193ebace5b9fb3672` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:43.401766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4b0226feb2406193ebace5b9fb3672)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:43.403765 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:43.591803 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4b0226feb2406193ebace5b9fb3672'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:43.606888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4b0226feb2406193ebace5b9fb3672'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:43.610511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4b0226feb2406193ebace5b9fb3672'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:43.611685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4b0226feb2406193ebace5b9fb3672'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:43.656572 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4b0226feb2406193ebace5b9fb3672'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:43.672694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1355/2710] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:43 2022] DELETE /identity/v3/users/0d4b0226feb2406193ebace5b9fb3672 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:43.677244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:43.677734 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:43.677955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:43.696922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:43.698152 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:43.762981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1356/2711] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:43.774206 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:43.775762 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:43.836947 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc779f9-7d2b-45b6-be58-fa685aadafef admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:43.840707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:43.841355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:43.841639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:43.841918 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:43.852000 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:43.853497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:43.863788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1356/2712] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:44.175193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:44.176980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:44.193651 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40501f5-7056-497e-a4af-4b51b60c191d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:44.199122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:44.200151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.200355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.200679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] PATH_INFO: `/v3/users/08b284e21fb24a6181b70c904c22665f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.201875 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b284e21fb24a6181b70c904c22665f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:44.203848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:44.325367 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:44.326820 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:44.340915 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda5390-1e28-49e5-83a5-bb4e63b24d92 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:44.351612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:44.352664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.352810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.353088 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] PATH_INFO: `/v3/projects/c9c22283bc0b41a69eb4ab3bbafc536d` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.354285 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c22283bc0b41a69eb4ab3bbafc536d)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:44.356242 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:44.427212 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b284e21fb24a6181b70c904c22665f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.434095 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b284e21fb24a6181b70c904c22665f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.434756 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b284e21fb24a6181b70c904c22665f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.435386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b284e21fb24a6181b70c904c22665f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.448366 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-47b87a8a-063b-4c0e-9b56-8acc75758fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b284e21fb24a6181b70c904c22665f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.496531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c22283bc0b41a69eb4ab3bbafc536d', 'request_id': 'req-eaf34536-ff40-418f-9525-091ab0483693'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.534057 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1357/2713] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:39:44 2022] DELETE /identity/v3/users/08b284e21fb24a6181b70c904c22665f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:44.622417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c22283bc0b41a69eb4ab3bbafc536d', 'request_id': 'req-eaf34536-ff40-418f-9525-091ab0483693'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.628527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c22283bc0b41a69eb4ab3bbafc536d', 'request_id': 'req-eaf34536-ff40-418f-9525-091ab0483693'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.640442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] The token cache is being invalidate because project c9c22283bc0b41a69eb4ab3bbafc536d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:44.641599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.641599 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-eaf34536-ff40-418f-9525-091ab0483693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:44.643336 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1357/2714] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:44 2022] DELETE /identity/v3/projects/c9c22283bc0b41a69eb4ab3bbafc536d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:39:44.648099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed235972-c712-4357-b819-d492aff1e37b None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.648459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed235972-c712-4357-b819-d492aff1e37b None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.648810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed235972-c712-4357-b819-d492aff1e37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.666500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-ed235972-c712-4357-b819-d492aff1e37b None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:44.667862 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ed235972-c712-4357-b819-d492aff1e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:44.726749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1358/2715] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:44.734577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.734869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.735158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.754989 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:44.756186 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:44.764736 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1358/2716] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:44.768960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed235972-c712-4357-b819-d492aff1e37b None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:44.778665 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed235972-c712-4357-b819-d492aff1e37b None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:44.783853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:44.784608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:44.785367 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.785716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.785910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:44.786396 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.787193 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:39:44.787593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:44.789569 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:44.807164 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1359/2717] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:39:44.807962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa072dc-a6c4-4ec3-a707-75bbb5e8725f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:44.811423 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:44.812917 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:44.813972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.814426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.814657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] PATH_INFO: `/v3/projects/f9ae1a3920c3485da0cc8f5f91108796` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.816122 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ae1a3920c3485da0cc8f5f91108796)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:44.818138 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:44.822071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aee92b-967c-40f9-9b3c-5824467e67c3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:44.827179 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:44.827861 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:44.828145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:44.828422 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:44.829122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:44.831331 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:44.940948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1360/2718] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:44 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:44.945133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:44.945579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ae1a3920c3485da0cc8f5f91108796', 'request_id': 'req-4be7f140-ca4b-4a11-a939-edd53d44d4c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:45.005408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969e9e5-46d9-485c-b330-4e68fea89763 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.010279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ae1a3920c3485da0cc8f5f91108796', 'request_id': 'req-4be7f140-ca4b-4a11-a939-edd53d44d4c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:45.010407 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.010975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.011284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.011573 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.012290 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.014209 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.016493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ae1a3920c3485da0cc8f5f91108796', 'request_id': 'req-4be7f140-ca4b-4a11-a939-edd53d44d4c2'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:45.027563 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] The token cache is being invalidate because project f9ae1a3920c3485da0cc8f5f91108796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:39:45.027846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:45.028497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-4be7f140-ca4b-4a11-a939-edd53d44d4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:39:45.030037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1359/2719] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:39:44 2022] DELETE /identity/v3/projects/f9ae1a3920c3485da0cc8f5f91108796 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:45.034798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923f44-a0a7-4c21-9d08-b3ce1f931836 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.035082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923f44-a0a7-4c21-9d08-b3ce1f931836 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.035393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923f44-a0a7-4c21-9d08-b3ce1f931836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.052905 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-3f923f44-a0a7-4c21-9d08-b3ce1f931836 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:45.054729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3f923f44-a0a7-4c21-9d08-b3ce1f931836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.062899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1360/2720] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:45.070205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.070663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.070972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.088728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:45.089911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.097944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1361/2721] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:45.102701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.103802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1361/2722] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:44 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:45.108703 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.110344 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.112069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c795a-73ac-4cb1-ab29-20b815a5bb56 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.117577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.118228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.118511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.118785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.119535 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:39:45.119843 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.121431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.123244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca4421-741d-49cd-ba53-7e78f28612e6 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.127916 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.128563 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.128849 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.129128 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.129902 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.131511 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.133004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1362/2723] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:39:45.137476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.142288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1362/2724] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:39:45.145844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.147388 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a76e6c-cfe2-4e7f-9aee-89857d3a4111 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.152223 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.152858 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.153141 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.153419 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.154125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.155813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9356b7-20ee-40e8-88a3-bab20752de89 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.156058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.160668 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.161300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.161586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.161869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.162603 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.164905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.175682 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1363/2725] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:39:45.180752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.190973 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32bd7-c1dc-40dd-87dd-bea93b51ccbc admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.195711 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d93039-95a4-47d0-9ecb-54eca82adbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.196560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d93039-95a4-47d0-9ecb-54eca82adbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.196844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d93039-95a4-47d0-9ecb-54eca82adbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.197118 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d93039-95a4-47d0-9ecb-54eca82adbdd admin admin] PATH_INFO: `/v3/projects/c0ed0b95fc8b4102a612dd3f9f1d8b2e/users/5891a66e80814fbba857283661704ca5/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.213121 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d93039-95a4-47d0-9ecb-54eca82adbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ed0b95fc8b4102a612dd3f9f1d8b2e, user_id=5891a66e80814fbba857283661704ca5, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.218826 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d93039-95a4-47d0-9ecb-54eca82adbdd admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.244133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1363/2726] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:45 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:45.248163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.295633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1364/2727] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:45 2022] PUT /identity/v3/projects/c0ed0b95fc8b4102a612dd3f9f1d8b2e/users/5891a66e80814fbba857283661704ca5/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:39:45.300589 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.300903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.301186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.313185 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c296f9-a697-4141-9a1d-24b70d92e5ba admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.318348 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:45.320123 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.370026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.370698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.370976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.371269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.371961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.373855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.380757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1365/2728] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:39:45.390479 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.391923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.446857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8d19-7165-4a73-bc50-b0cf114a49b0 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.449028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1364/2729] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:45 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:39:45.450547 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.451282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.451586 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.453842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.453961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.463030 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.463862 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ca4e-1f57-41ed-aad2-cb0ebc32ea25 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.464556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.468446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.469089 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.469817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.469817 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.470366 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.471956 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.474157 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1366/2730] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:39:45.483859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1365/2731] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:39:45.491045 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.501307 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c203f6-d632-49a5-9c31-17a38811109b service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.505998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b949347-c327-4fa1-9def-b03c56027f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.506722 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949347-c327-4fa1-9def-b03c56027f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.507117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949347-c327-4fa1-9def-b03c56027f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.507685 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949347-c327-4fa1-9def-b03c56027f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.508018 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b949347-c327-4fa1-9def-b03c56027f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.509618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b949347-c327-4fa1-9def-b03c56027f6b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.520130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1367/2732] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:45.524923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.534630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539b92-e12b-437e-9df5-dedcdd32bad6 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.539779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.540638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.540923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.541197 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] PATH_INFO: `/v3/projects/e36f54435f99423f9fb3f1ca18184f44/users/a7044b954813429d96e3982139a6f513/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.555848 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36f54435f99423f9fb3f1ca18184f44, user_id=a7044b954813429d96e3982139a6f513, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.558498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.683068 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1366/2733] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:45 2022] PUT /identity/v3/projects/e36f54435f99423f9fb3f1ca18184f44/users/a7044b954813429d96e3982139a6f513/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:45.688166 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863692be-b0ba-4ef4-8463-0ef2e6955c0f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.688657 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863692be-b0ba-4ef4-8463-0ef2e6955c0f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.688947 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863692be-b0ba-4ef4-8463-0ef2e6955c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.707214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-863692be-b0ba-4ef4-8463-0ef2e6955c0f None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:45.708440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-863692be-b0ba-4ef4-8463-0ef2e6955c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.768021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1368/2734] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:45.778494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:45.780352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:45.837425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d0e5a-0acf-4060-b950-7ae566f45200 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:45.841101 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:45.841772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:45.842054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:45.842324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:45.852032 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:45.853446 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:45.863851 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1367/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:51.744389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:51.745296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:51.745748 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:51.780136 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] MFA Rules not processed for user `5891a66e80814fbba857283661704ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:51.781867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:51.880228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1369/2736] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:51.885609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:51.900330 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bac81-c839-4f0a-b97b-8ce0a4e9e126 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:51.916201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874bcf1-1785-4b77-82cb-117f49858510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:51.917105 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874bcf1-1785-4b77-82cb-117f49858510 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:51.917557 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874bcf1-1785-4b77-82cb-117f49858510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:51.918012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874bcf1-1785-4b77-82cb-117f49858510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:51.918885 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874bcf1-1785-4b77-82cb-117f49858510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:51.921195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874bcf1-1785-4b77-82cb-117f49858510 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.046547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1368/2737] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:39:51 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:52.051217 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:52.068129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c4f7-21ad-4bcd-b163-c623c6962316 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:52.143528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:52.144349 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.144735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.144845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.145131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.145273 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.145449 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.146161 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:52.148454 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.174547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] MFA Rules not processed for user `a7044b954813429d96e3982139a6f513`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:52.175785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:52.251084 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1369/2738] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:52.263889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:52.265364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:52.317759 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1370/2739] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:39:52 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:39:52.322265 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:52.342093 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891781-9235-4119-a103-f29c1e6483af admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:52.356251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:52.357435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.357731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.358012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.358814 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:52.360464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.378773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1371/2740] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:52.382545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:52.393598 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb38d5-fc5a-4d3b-b54e-b6fa80e5304b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:52.397704 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd640445-d73c-4cbc-bcfe-de30743476b3 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:52.399456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:52.400544 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.400842 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.401126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] PATH_INFO: `/v3/projects/57a2b3c5a97d4c75a9dbc02c19df8cf0/users/37cf2dd342764a3b90321a6ccfc21a26/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.415818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:52.416707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.417145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.417591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.419492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a2b3c5a97d4c75a9dbc02c19df8cf0, user_id=37cf2dd342764a3b90321a6ccfc21a26, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:52.422223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.427487 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:52.430074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.441891 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1370/2741] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:39:52.527374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1372/2742] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:52 2022] PUT /identity/v3/projects/57a2b3c5a97d4c75a9dbc02c19df8cf0/users/37cf2dd342764a3b90321a6ccfc21a26/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:39:52.529149 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:52.558946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709512-a75b-4317-9083-fb7601401a43 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:52.636600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37339769-6145-4384-8ae0-16bc70025cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:52.637430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37339769-6145-4384-8ae0-16bc70025cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.637723 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37339769-6145-4384-8ae0-16bc70025cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.638002 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37339769-6145-4384-8ae0-16bc70025cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.638766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37339769-6145-4384-8ae0-16bc70025cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:52.640610 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37339769-6145-4384-8ae0-16bc70025cc1 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.653581 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1371/2743] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:39:52.657716 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:52.675609 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d6bcd-7216-4d9a-b225-141f266dc349 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:52.682368 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:52.683403 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:52.683757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:52.684109 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] PATH_INFO: `/v3/projects/57a2b3c5a97d4c75a9dbc02c19df8cf0/users/37cf2dd342764a3b90321a6ccfc21a26/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:52.686204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a2b3c5a97d4c75a9dbc02c19df8cf0, user_id=37cf2dd342764a3b90321a6ccfc21a26, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:52.689190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:52.702828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1373/2744] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:39:52 2022] PUT /identity/v3/projects/57a2b3c5a97d4c75a9dbc02c19df8cf0/users/37cf2dd342764a3b90321a6ccfc21a26/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:39:55.839899 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:55.840755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:55.841334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:55.867597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] MFA Rules not processed for user `a7044b954813429d96e3982139a6f513`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:39:55.869375 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:55.953311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1372/2745] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:39:56.302352 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:56.383959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b29ff3-9629-447c-a1ef-cd2ad5ccb38a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:56.399868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:56.400981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:56.401565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:56.402023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:56.405302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:56.426153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:56.428612 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6250-c94c-4b84-9ea7-020990c4a8e8 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:56.438670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1374/2746] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:39:58.020313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:39:58.021749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:58.161062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7207a8a-bebd-4fa4-a8ac-85f48c6899d4 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:39:58.168829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:39:58.170153 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:39:58.171211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:39:58.171985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:39:58.175879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:39:58.206021 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:39:58.207734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:39:58.222955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1373/2747] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:00.042535 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51320c1-9e9e-4dea-b909-8713ba0dc06e None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:00.043017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51320c1-9e9e-4dea-b909-8713ba0dc06e None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:00.043107 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51320c1-9e9e-4dea-b909-8713ba0dc06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:00.071933 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-a51320c1-9e9e-4dea-b909-8713ba0dc06e None None] MFA Rules not processed for user `37cf2dd342764a3b90321a6ccfc21a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:40:00.073126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a51320c1-9e9e-4dea-b909-8713ba0dc06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:00.141079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1375/2748] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:40:00.152427 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:00.153810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:00.226601 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c572eb-4c53-496c-a928-651798fb4c28 service placement] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:00.233421 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:00.234328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:00.234328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:00.234620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:00.293742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:00.295225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:00.305292 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1374/2749] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:03.019476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:03.020005 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:03.020106 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:03.048662 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] MFA Rules not processed for user `5891a66e80814fbba857283661704ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:40:03.049852 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:03.075529 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1376/2750] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:40:13.896199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:13.936499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f16074-6c41-46e0-8ecc-c98ad501f7f0 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:13.942091 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:13.942755 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:13.943038 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:13.943344 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:13.945083 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:13.968369 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:13.969946 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:13.981200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1375/2751] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:29.585892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:29.607440 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a400-e659-4486-bc0f-d74a3eeb4d1f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:29.611147 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:29.611830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:29.612114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:29.612389 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:29.614243 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:29.637531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:29.639026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:29.647322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1377/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:40:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:32.313258 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:32.325069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7c323-fc34-4c4d-9ee3-9ce93eee500e service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:32.331062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:32.331749 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:32.332035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:32.332313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:32.334103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:32.347346 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:32.348923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:32.359634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1376/2753] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:44.254083 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:44.266508 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8c63-4282-440a-ae98-3c433ee0d751 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:44.270995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:44.271752 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:44.272041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:44.272324 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:44.274117 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:44.369125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:44.370498 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:44.393186 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1378/2754] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:49.312935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:49.325108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a55be-b9c4-4837-bf19-97e8a83c6d64 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:49.330944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:49.331626 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:49.332119 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:49.332593 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:49.342722 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:49.344312 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:49.355381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1377/2755] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:40:52.160969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:52.162415 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:52.175300 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a2fc3-921a-49bd-ae36-377854c1818a service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:52.180226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:52.181533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:52.182137 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:52.182568 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] PATH_INFO: `/v3/users/fe4733f5e72d4a3ab627a4fd80ee76e5` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:52.202830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4733f5e72d4a3ab627a4fd80ee76e5)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:52.207059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:52.510080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4733f5e72d4a3ab627a4fd80ee76e5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:52.518191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4733f5e72d4a3ab627a4fd80ee76e5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:52.520608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4733f5e72d4a3ab627a4fd80ee76e5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:52.520608 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4733f5e72d4a3ab627a4fd80ee76e5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:52.534438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4733f5e72d4a3ab627a4fd80ee76e5'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:52.627033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1379/2756] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:40:52 2022] DELETE /identity/v3/users/fe4733f5e72d4a3ab627a4fd80ee76e5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:40:52.882190 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:52.894743 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a7d7-d64c-4cd1-a029-a7bc80292479 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:52.951783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:52.952689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:52.953126 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:52.953408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] PATH_INFO: `/v3/projects/81a8a6f34abb4f4884dc35c6a4cf1d43` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:52.964019 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a8a6f34abb4f4884dc35c6a4cf1d43)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:52.965936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:53.067741 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a8a6f34abb4f4884dc35c6a4cf1d43', 'request_id': 'req-30839c97-c736-4351-8cb0-7b2cb66ac453'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.113814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a8a6f34abb4f4884dc35c6a4cf1d43', 'request_id': 'req-30839c97-c736-4351-8cb0-7b2cb66ac453'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.119299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a8a6f34abb4f4884dc35c6a4cf1d43', 'request_id': 'req-30839c97-c736-4351-8cb0-7b2cb66ac453'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.131106 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] The token cache is being invalidate because project 81a8a6f34abb4f4884dc35c6a4cf1d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:40:53.131371 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.132026 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.133566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1378/2757] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:40:52 2022] DELETE /identity/v3/projects/81a8a6f34abb4f4884dc35c6a4cf1d43 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:40:53.137613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:53.138990 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:53.152002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c524e-b493-49b1-bbec-03d421e830c3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:53.206363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:53.207229 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:53.207546 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:53.207822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] PATH_INFO: `/v3/users/e1759889a4bb401fa1b1fb27c9a4a132` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:53.220994 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1759889a4bb401fa1b1fb27c9a4a132)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:53.222903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:53.417028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1759889a4bb401fa1b1fb27c9a4a132'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.423934 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1759889a4bb401fa1b1fb27c9a4a132'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.424633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1759889a4bb401fa1b1fb27c9a4a132'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.425232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1759889a4bb401fa1b1fb27c9a4a132'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.436506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1759889a4bb401fa1b1fb27c9a4a132'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:53.518519 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1380/2758] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:40:53 2022] DELETE /identity/v3/users/e1759889a4bb401fa1b1fb27c9a4a132 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:40:53.778459 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:40:53.780042 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:40:53.794480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c97-c736-4351-8cb0-7b2cb66ac453 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:40:53.852445 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:40:53.853313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:40:53.853597 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:40:53.853874 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] PATH_INFO: `/v3/projects/c5bcac88c21b4fe6a3b0b3abd5a9173f` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:40:53.864937 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bcac88c21b4fe6a3b0b3abd5a9173f)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:40:53.866855 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:40:53.962861 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bcac88c21b4fe6a3b0b3abd5a9173f', 'request_id': 'req-9f6532a1-5b19-4e95-93bb-db0a96cae56e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:54.020231 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bcac88c21b4fe6a3b0b3abd5a9173f', 'request_id': 'req-9f6532a1-5b19-4e95-93bb-db0a96cae56e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:54.025596 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bcac88c21b4fe6a3b0b3abd5a9173f', 'request_id': 'req-9f6532a1-5b19-4e95-93bb-db0a96cae56e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:54.038612 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] The token cache is being invalidate because project c5bcac88c21b4fe6a3b0b3abd5a9173f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:40:54.038894 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:54.039525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-9f6532a1-5b19-4e95-93bb-db0a96cae56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:40:54.041073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1379/2759] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:40:53 2022] DELETE /identity/v3/projects/c5bcac88c21b4fe6a3b0b3abd5a9173f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:41:15.090150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:41:15.091577 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:41:15.180361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ce98-8eb0-4cd5-838d-460102e8715c admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:41:15.239244 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:41:15.239914 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:41:15.240200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:41:15.240476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:41:15.242236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:41:15.254116 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:41:15.255720 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:41:15.265386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1381/2760] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:41:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:41:45.713638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:41:45.714189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:41:45.714189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:41:45.731818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] MFA Rules not processed for user `a7044b954813429d96e3982139a6f513`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:41:45.733016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:41:45.788568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1380/2761] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:43:07.583540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:43:07.584948 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:07.644560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee397b-0867-481c-aa4a-62ec3960fbda service placement] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:43:07.648154 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:43:07.648790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:43:07.649102 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:43:07.649381 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:43:07.652067 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:07.741204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:43:07.742647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:43:07.762672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1382/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:43:08.933028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:43:08.942545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a644a7-6284-48a1-a826-4f17543e445e None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:43:08.946028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:43:08.946659 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:43:08.946938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:43:08.947209 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:43:08.949241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:08.962092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:43:08.963547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:43:08.974095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1381/2763] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:43:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:43:27.238411 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:43:27.254689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c61e9-4d64-4fec-bfe5-0cc2a4993113 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:43:27.254689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:43:27.254689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:43:27.254689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:43:27.255133 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:43:27.256570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:27.268809 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:43:27.270240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcdf3f-6068-4f0f-b3a0-3b8e7e7b2227 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:43:27.283004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1383/2764] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:43:27.362751 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:43:27.364355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:27.375758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405945db-cca9-48df-8985-8185be93f960 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:43:27.379492 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:43:27.380133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:43:27.380414 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:43:27.380697 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:43:27.382525 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:27.396335 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:43:27.397759 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:43:27.408940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1382/2765] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:43:31.326712 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:43:31.327227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:43:31.327357 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:43:31.344561 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] MFA Rules not processed for user `a7044b954813429d96e3982139a6f513`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:43:31.345813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:43:31.353060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1384/2766] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:44:25.868210 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:44:25.877642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf667709-462c-4009-a062-5c73c37281da service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:44:25.881295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:44:25.881924 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:44:25.882205 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:44:25.882482 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:44:25.884279 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:44:25.893982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:44:25.895460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:44:25.903282 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1383/2767] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:44:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:02.506058 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:02.507470 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:02.523666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a2c9d-bedc-405f-8db2-b6216874bd10 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:02.529033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:02.529663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:02.529943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:02.530214 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:02.532090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:02.542026 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:02.543623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:02.552475 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1385/2768] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:12.609556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:12.618528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923db59b-08c6-4da3-872d-a81680eb86a2 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:12.622143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:12.622771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:12.623051 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:12.623355 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:12.625112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:12.683137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:12.684639 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:12.694633 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1384/2769] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:13.613098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:13.627325 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d687c21-e339-4bae-aa64-d559a8db0c7d service nova] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:13.634170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:13.635059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:13.635540 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:13.636039 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:13.638771 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:13.653766 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:13.655478 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c682e7-c689-4b1c-9ead-27e52540f493 service nova] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:13.666830 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1386/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:20.244524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:20.253411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44af5-39a6-462c-accc-5e73ebe0f136 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:20.257096 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:20.257737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:20.258033 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:20.258313 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:20.260103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:20.326189 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:20.327742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:20.338072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1385/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:23.027392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:23.027936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:23.027936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:23.047100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] MFA Rules not processed for user `a7044b954813429d96e3982139a6f513`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:45:23.048788 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:23.060355 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1387/2772] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:45:23.531179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:23.539698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e58c9-b44a-499d-82f0-4a78edecbbea service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:23.543341 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:23.543981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:23.544261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:23.544542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:23.546307 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:23.556328 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:23.557745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:23.566531 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1386/2773] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:24.166936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:24.168431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:24.183604 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46695d-0aff-4ca0-95e6-4c3f253480b6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:24.189369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:24.190015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:24.190297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:24.190572 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:24.192400 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:24.206989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:24.208636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:24.222811 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1388/2774] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:45:28.590717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:28.599338 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:28.613551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921f66-0586-4a2c-b7a1-abbeaf143703 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:28.618065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:28.618971 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:28.619199 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:28.619497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] PATH_INFO: `/v3/users/5891a66e80814fbba857283661704ca5` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:28.620690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5891a66e80814fbba857283661704ca5)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:28.622585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:28.825430 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5891a66e80814fbba857283661704ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:28.837886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5891a66e80814fbba857283661704ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:28.838579 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5891a66e80814fbba857283661704ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:28.839417 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5891a66e80814fbba857283661704ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:28.916513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5891a66e80814fbba857283661704ca5'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:28.929008 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1387/2775] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:45:28 2022] DELETE /identity/v3/users/5891a66e80814fbba857283661704ca5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:45:29.176134 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:29.195930 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd29dd-dd75-4684-a2fa-2945bc8bd144 service placement] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:29.245477 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:29.246341 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:29.246625 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:29.246931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] PATH_INFO: `/v3/projects/c0ed0b95fc8b4102a612dd3f9f1d8b2e` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:29.248158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ed0b95fc8b4102a612dd3f9f1d8b2e)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:29.251050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:29.382162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ed0b95fc8b4102a612dd3f9f1d8b2e', 'request_id': 'req-4a40020e-afc3-4ec7-8fc1-cac3ff896093'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.387591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ed0b95fc8b4102a612dd3f9f1d8b2e', 'request_id': 'req-4a40020e-afc3-4ec7-8fc1-cac3ff896093'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.393820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ed0b95fc8b4102a612dd3f9f1d8b2e', 'request_id': 'req-4a40020e-afc3-4ec7-8fc1-cac3ff896093'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.452495 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] The token cache is being invalidate because project c0ed0b95fc8b4102a612dd3f9f1d8b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:45:29.452787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.453412 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.454983 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1389/2776] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:45:29 2022] DELETE /identity/v3/projects/c0ed0b95fc8b4102a612dd3f9f1d8b2e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:45:29.458977 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:29.460413 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:29.473789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80c0e-2b5c-4152-9b10-1d97b5a1de0e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:29.527889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:29.528785 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:29.529069 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:29.529340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] PATH_INFO: `/v3/users/37cf2dd342764a3b90321a6ccfc21a26` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:29.530500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cf2dd342764a3b90321a6ccfc21a26)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:29.533214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:29.707494 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cf2dd342764a3b90321a6ccfc21a26'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.719339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cf2dd342764a3b90321a6ccfc21a26'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.720016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cf2dd342764a3b90321a6ccfc21a26'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.720642 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cf2dd342764a3b90321a6ccfc21a26'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.802319 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cf2dd342764a3b90321a6ccfc21a26'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:29.815073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1388/2777] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:45:29 2022] DELETE /identity/v3/users/37cf2dd342764a3b90321a6ccfc21a26 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:45:30.099114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:30.100825 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:30.116774 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40020e-afc3-4ec7-8fc1-cac3ff896093 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:30.174459 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:30.175369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:30.175643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:30.175922 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] PATH_INFO: `/v3/projects/57a2b3c5a97d4c75a9dbc02c19df8cf0` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:30.177131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a2b3c5a97d4c75a9dbc02c19df8cf0)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:30.179074 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:30.300549 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a2b3c5a97d4c75a9dbc02c19df8cf0', 'request_id': 'req-72289860-f783-42f9-a369-fc99744c5469'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:30.305822 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a2b3c5a97d4c75a9dbc02c19df8cf0', 'request_id': 'req-72289860-f783-42f9-a369-fc99744c5469'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:30.311877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a2b3c5a97d4c75a9dbc02c19df8cf0', 'request_id': 'req-72289860-f783-42f9-a369-fc99744c5469'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:30.403939 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] The token cache is being invalidate because project 57a2b3c5a97d4c75a9dbc02c19df8cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:45:30.404226 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:30.404829 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:45:30.406899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1390/2778] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:45:30 2022] DELETE /identity/v3/projects/57a2b3c5a97d4c75a9dbc02c19df8cf0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:45:33.441056 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:45:33.443059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:33.517889 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ac9ae-315d-4675-bb0b-c11ab187006e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:45:33.585241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:45:33.585241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:45:33.585241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:45:33.585547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:45:33.587099 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:45:33.599130 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:45:33.600742 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:45:33.611745 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1389/2779] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:46:22.096098 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:46:22.097583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:46:22.164363 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72289860-f783-42f9-a369-fc99744c5469 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:46:22.169236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:46:22.169870 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:46:22.170155 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:46:22.170432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:46:22.172176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:46:22.183884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:46:22.185446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:46:22.196099 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1391/2780] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:46:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:46:56.560849 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:46:56.562247 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:46:56.576225 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9429-d1e1-4da8-b21a-2e6d6a7252ef service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:46:56.583951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bc226da24944f578dd20785b5bcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:46:56.584678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:46:56.585028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:46:56.585372 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:46:56.587324 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:46:56.600666 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:46:56.602684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:46:56.615939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1390/2781] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:03.215056 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:03.216503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:03.271969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038dda-2142-4d0f-8604-2ee5aa66a6b2 service placement] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:03.275538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:03.276167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:03.276447 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:03.276721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:03.278439 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:03.338613 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:03.340071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:03.349256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1392/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:06.925238 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:06.926690 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:06.941836 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24e86e-bf62-4ef3-a951-35e83b9f89e9 service nova] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:06.946699 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:06.947622 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:06.947910 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:06.948192 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] PATH_INFO: `/v3/users/a7044b954813429d96e3982139a6f513` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:06.949380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7044b954813429d96e3982139a6f513)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:06.951349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:07.127218 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7044b954813429d96e3982139a6f513'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.138416 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7044b954813429d96e3982139a6f513'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.139059 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7044b954813429d96e3982139a6f513'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.139678 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7044b954813429d96e3982139a6f513'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.206158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-a9a4b523-c132-4c2c-97ed-0c5ec71c2d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7044b954813429d96e3982139a6f513'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.219382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1391/2783] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:06 2022] DELETE /identity/v3/users/a7044b954813429d96e3982139a6f513 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:07.487539 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:07.497614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c53c-4895-4d23-85a5-8af116f9aeab service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:07.555427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:07.556297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:07.556579 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:07.557153 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] PATH_INFO: `/v3/projects/e36f54435f99423f9fb3f1ca18184f44` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:07.558149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36f54435f99423f9fb3f1ca18184f44)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:07.560100 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:07.663192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36f54435f99423f9fb3f1ca18184f44', 'request_id': 'req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.668556 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36f54435f99423f9fb3f1ca18184f44', 'request_id': 'req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.674624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36f54435f99423f9fb3f1ca18184f44', 'request_id': 'req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.736784 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] The token cache is being invalidate because project e36f54435f99423f9fb3f1ca18184f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:07.737047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.737594 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-9923dba4-ae21-4513-bb29-da0bdc5a8bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:07.739142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1393/2784] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:07 2022] DELETE /identity/v3/projects/e36f54435f99423f9fb3f1ca18184f44 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:07.745071 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:07.745361 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:07.745641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:07.801125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:07.802310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:07.861252 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1392/2785] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:07.870170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:07.870466 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:07.870786 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:07.890484 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:07.891718 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:07.899762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1394/2786] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:07.903823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:07.913363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b035-8036-486e-9c90-7b8c359c4c06 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:07.917942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:07.918590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:07.918872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:07.919145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:07.919900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:47:07.920212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:07.921799 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:07.933630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1393/2787] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:47:07.937803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:07.947839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197193b-ad86-4c02-bbac-f7e99e3eb6b6 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:07.952538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:07.953181 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:07.953464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:07.953737 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:07.954520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:07.956533 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:08.047543 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1395/2788] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:07 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:08.051556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:08.062384 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b76e-85d0-4066-a5b5-69add76b79ba admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:08.120613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:08.121280 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:08.121565 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:08.121845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:08.122521 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:08.124460 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:08.234754 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1394/2789] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:08 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:08.238869 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:08.257565 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772e8dc-a053-4050-bfa2-fcd374e458f3 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:08.262055 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:08.262709 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:08.262993 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:08.263297 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:08.264022 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:08.265624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:08.276312 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1396/2790] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:08.280183 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:08.291077 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28cce0-24c7-43e5-bf5a-b26f61efed0c admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:08.295707 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7879-37ba-40ee-84f8-ac0181e70de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:08.296353 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7879-37ba-40ee-84f8-ac0181e70de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:08.296632 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7879-37ba-40ee-84f8-ac0181e70de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:08.296906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7879-37ba-40ee-84f8-ac0181e70de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:08.297669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae7879-37ba-40ee-84f8-ac0181e70de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:08.299181 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae7879-37ba-40ee-84f8-ac0181e70de9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:08.309780 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1395/2791] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:08.313931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:08.324043 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f99e1-9afc-44b4-81bb-cf1f0d29820e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:08.328637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:08.329510 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:08.329798 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:08.330080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] PATH_INFO: `/v3/projects/976ae7b9bb78428b949d885bfdcbb20b/users/c24b4c939e4b465089d302f2b7b1e2cf/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:08.344382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976ae7b9bb78428b949d885bfdcbb20b, user_id=c24b4c939e4b465089d302f2b7b1e2cf, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:08.347013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:08.430506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1397/2792] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:08 2022] PUT /identity/v3/projects/976ae7b9bb78428b949d885bfdcbb20b/users/c24b4c939e4b465089d302f2b7b1e2cf/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:08.435703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3056-eedf-49cc-9587-9557fba16fb1 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:08.435995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3056-eedf-49cc-9587-9557fba16fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:08.436275 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3056-eedf-49cc-9587-9557fba16fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:08.454733 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5ddc3056-eedf-49cc-9587-9557fba16fb1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:08.455973 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5ddc3056-eedf-49cc-9587-9557fba16fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:08.512802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1396/2793] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 16:47:08.522796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:08.524559 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:08.586583 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60caeb9-67d6-4d8c-bf12-61f3106076f2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:08.590337 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:08.590977 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:08.591313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:08.591600 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:08.601353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:08.602790 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:08.612180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1398/2794] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:09.755912 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:09.756664 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:09.757052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:09.786035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] MFA Rules not processed for user `c24b4c939e4b465089d302f2b7b1e2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:09.787882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:09.854606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1397/2795] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:09.859047 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:09.869241 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9337f-1b94-4c26-a922-fdc8a0261acf service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:09.873927 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:09.874570 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:09.874851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:09.875122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:09.875844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:09.878527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:09.963063 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1399/2796] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:09 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:09.967035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:09.979295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921cff0-788f-464f-8bf6-be7e5f61d8ee None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:10.036980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:10.037853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:10.038168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:10.038442 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:10.039115 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:10.042901 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:10.148432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1398/2797] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:09 2022] POST /identity/v3/users => generated 308 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:47:10.152388 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:10.162970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5577-e580-45ad-9359-ced4b4a76b9b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:10.167923 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:10.168580 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:10.168868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:10.169151 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:10.169878 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:10.171560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:10.182980 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1400/2798] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:47:10.186981 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:10.197890 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a0340-3086-40f8-9d6a-6a51d09a868e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:10.202605 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:10.203513 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:10.203798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:10.204074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] PATH_INFO: `/v3/projects/28d550e2a0ec46548f7c1ebd41b3ca04/users/2cd66508e3f147c9b82e801baf050831/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:10.218819 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d550e2a0ec46548f7c1ebd41b3ca04, user_id=2cd66508e3f147c9b82e801baf050831, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:10.221490 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:10.297103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1399/2799] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:10 2022] PUT /identity/v3/projects/28d550e2a0ec46548f7c1ebd41b3ca04/users/2cd66508e3f147c9b82e801baf050831/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:10.300951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:10.311802 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34010-d7a1-4727-94bb-3b0f54b3e413 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:10.369857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4331c5-7e70-4234-886b-b1f3170a587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:10.370520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4331c5-7e70-4234-886b-b1f3170a587f admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:10.370810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4331c5-7e70-4234-886b-b1f3170a587f admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:10.371088 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4331c5-7e70-4234-886b-b1f3170a587f admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:10.371840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4331c5-7e70-4234-886b-b1f3170a587f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:10.373441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4331c5-7e70-4234-886b-b1f3170a587f admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:10.383304 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1401/2800] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:10.387511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:10.398037 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2af93-8dd6-47ec-a528-b3af989b6233 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:10.402702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:10.403606 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:10.403893 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:10.404168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] PATH_INFO: `/v3/projects/28d550e2a0ec46548f7c1ebd41b3ca04/users/2cd66508e3f147c9b82e801baf050831/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:10.406133 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d550e2a0ec46548f7c1ebd41b3ca04, user_id=2cd66508e3f147c9b82e801baf050831, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:10.408814 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:10.419580 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1400/2801] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:10 2022] PUT /identity/v3/projects/28d550e2a0ec46548f7c1ebd41b3ca04/users/2cd66508e3f147c9b82e801baf050831/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:11.500011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:11.501010 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:11.501483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:11.530431 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] MFA Rules not processed for user `2cd66508e3f147c9b82e801baf050831`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:11.531697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:11.602691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1402/2802] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:12.917590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:12.980365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cd39f-934e-469f-aa5d-f459aaf7c76b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:12.985072 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:12.985936 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:12.986220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:12.986497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] PATH_INFO: `/v3/users/c24b4c939e4b465089d302f2b7b1e2cf` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:12.987694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24b4c939e4b465089d302f2b7b1e2cf)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:12.989734 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:13.161317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24b4c939e4b465089d302f2b7b1e2cf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.173423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24b4c939e4b465089d302f2b7b1e2cf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.174090 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24b4c939e4b465089d302f2b7b1e2cf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.174692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24b4c939e4b465089d302f2b7b1e2cf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.256484 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24b4c939e4b465089d302f2b7b1e2cf'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.268651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1401/2803] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:12 2022] DELETE /identity/v3/users/c24b4c939e4b465089d302f2b7b1e2cf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:13.528840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:13.540322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f4a5-f394-4ada-a0da-c5d89a4e04ed None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:13.597418 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:13.598302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:13.598587 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:13.598863 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] PATH_INFO: `/v3/projects/976ae7b9bb78428b949d885bfdcbb20b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:13.600222 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976ae7b9bb78428b949d885bfdcbb20b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:13.602289 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:13.714706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976ae7b9bb78428b949d885bfdcbb20b', 'request_id': 'req-d60f2913-6ea8-43c9-90a4-121982c8b5d8'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.720041 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976ae7b9bb78428b949d885bfdcbb20b', 'request_id': 'req-d60f2913-6ea8-43c9-90a4-121982c8b5d8'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.726279 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976ae7b9bb78428b949d885bfdcbb20b', 'request_id': 'req-d60f2913-6ea8-43c9-90a4-121982c8b5d8'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.793427 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] The token cache is being invalidate because project 976ae7b9bb78428b949d885bfdcbb20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:13.793725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.794358 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:13.795951 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1403/2804] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:13 2022] DELETE /identity/v3/projects/976ae7b9bb78428b949d885bfdcbb20b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:13.799888 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:13.801432 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:13.815061 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0424b-b9ee-4e45-9a76-d60ab538a80e admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:13.871064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:13.871957 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:13.872241 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:13.872545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] PATH_INFO: `/v3/users/2cd66508e3f147c9b82e801baf050831` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:13.873720 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd66508e3f147c9b82e801baf050831)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:13.875705 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:14.024500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd66508e3f147c9b82e801baf050831'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.035748 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd66508e3f147c9b82e801baf050831'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.036403 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd66508e3f147c9b82e801baf050831'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.037003 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd66508e3f147c9b82e801baf050831'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.086227 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-acd3ef90-c34a-4512-a343-cd784c223cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd66508e3f147c9b82e801baf050831'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.098393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1402/2805] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:13 2022] DELETE /identity/v3/users/2cd66508e3f147c9b82e801baf050831 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:47:14.322971 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:14.324456 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:14.337619 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2913-6ea8-43c9-90a4-121982c8b5d8 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:14.395225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:14.396122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:14.396417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:14.396695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] PATH_INFO: `/v3/projects/28d550e2a0ec46548f7c1ebd41b3ca04` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:14.397892 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d550e2a0ec46548f7c1ebd41b3ca04)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:14.400204 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:14.509480 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d550e2a0ec46548f7c1ebd41b3ca04', 'request_id': 'req-5e33aa35-ebe5-4201-8120-0d7f077278b3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.514815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d550e2a0ec46548f7c1ebd41b3ca04', 'request_id': 'req-5e33aa35-ebe5-4201-8120-0d7f077278b3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.521200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d550e2a0ec46548f7c1ebd41b3ca04', 'request_id': 'req-5e33aa35-ebe5-4201-8120-0d7f077278b3'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.599387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] The token cache is being invalidate because project 28d550e2a0ec46548f7c1ebd41b3ca04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:14.600012 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.600216 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-5e33aa35-ebe5-4201-8120-0d7f077278b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:14.602264 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1404/2806] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:14 2022] DELETE /identity/v3/projects/28d550e2a0ec46548f7c1ebd41b3ca04 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:14.607136 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:14.607456 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:14.608289 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:14.625926 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:14.627152 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:14.685276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1403/2807] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:14.693094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:14.693386 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:14.693666 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:14.713537 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:14.714731 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:14.722624 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1405/2808] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:14.727463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:14.736879 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2362-346b-4f82-b681-cb0e1039c847 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:14.741352 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:14.742835 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:14.743118 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:14.743425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:14.744170 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:47:14.744498 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:14.746081 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:14.757561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1404/2809] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:47:14.761702 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:14.770669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33e682-b35e-4a9c-aeb9-8229540277c1 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:14.775313 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:14.775945 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:14.776227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:14.776501 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:14.777184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:14.779044 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:14.869628 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1406/2810] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:14 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:14.873591 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:14.883728 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc73-900c-4bbb-88c4-93291cb3477f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:14.938864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:14.939812 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:14.940098 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:14.940374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:14.941055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:14.942978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.046527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1405/2811] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:14 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:15.050710 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.061162 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1e5d-8c62-487c-b770-d590d0804052 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.066288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.066932 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.067211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.067520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.068234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.069941 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.080191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1407/2812] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:15.083962 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.094310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf19b51-75bf-480f-bfd6-e0240c3f0059 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.098935 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d51b1-16fb-456d-8172-c1dcd92d41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.099609 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d51b1-16fb-456d-8172-c1dcd92d41fc admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.099897 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d51b1-16fb-456d-8172-c1dcd92d41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.100179 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d51b1-16fb-456d-8172-c1dcd92d41fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.100938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d51b1-16fb-456d-8172-c1dcd92d41fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.103220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d51b1-16fb-456d-8172-c1dcd92d41fc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.112834 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1406/2813] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:15.116724 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.126636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f32704-87d9-4483-9bf6-486a88c37754 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.131227 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.132111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.132443 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.132828 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] PATH_INFO: `/v3/projects/e7853ca1d4c34e3f98c4752a262ea22f/users/2af8a3cba1214848b79211ce94f2178f/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.146644 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7853ca1d4c34e3f98c4752a262ea22f, user_id=2af8a3cba1214848b79211ce94f2178f, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.149785 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.268338 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1408/2814] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:15 2022] PUT /identity/v3/projects/e7853ca1d4c34e3f98c4752a262ea22f/users/2af8a3cba1214848b79211ce94f2178f/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:15.278998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.279321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.279608 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.305500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] MFA Rules not processed for user `2af8a3cba1214848b79211ce94f2178f`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:15.306688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:15.368464 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1407/2815] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:15.372882 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.434345 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2dec8-6edc-41ed-8147-8b2e6bb3d394 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.438924 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.439855 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.440143 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.440421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.441096 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.443008 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.555615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1409/2816] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:15 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:15.559685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.571157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0590-2ffb-443a-88dd-ea5b3678a3bc None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.626872 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.627567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.627850 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.628125 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.628806 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.630710 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.714714 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1408/2817] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:15 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:15.718548 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.729247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9af6b-bb59-4019-ab36-1648d4ca7d73 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.733883 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.734530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.734812 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.735092 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.735877 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.737463 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.748497 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1410/2818] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:15.752527 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.763214 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299302ec-b4c5-4437-8742-712b58582d05 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.767789 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.768663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.768948 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.769224 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] PATH_INFO: `/v3/projects/08113cb0fefd4f14815acec05f6d9bfc/users/4a44f1e96b6e4ae1913d5782e20134d1/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.783715 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08113cb0fefd4f14815acec05f6d9bfc, user_id=4a44f1e96b6e4ae1913d5782e20134d1, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.786349 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.839220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1409/2819] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:15 2022] PUT /identity/v3/projects/08113cb0fefd4f14815acec05f6d9bfc/users/4a44f1e96b6e4ae1913d5782e20134d1/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:15.843035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.853086 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367692d1-d691-458a-b63b-19e6426665ba admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.909007 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a6b50-1098-4714-b374-36ff9a75c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.909667 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a6b50-1098-4714-b374-36ff9a75c519 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.909954 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a6b50-1098-4714-b374-36ff9a75c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.910234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a6b50-1098-4714-b374-36ff9a75c519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.910949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a6b50-1098-4714-b374-36ff9a75c519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.912606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a6b50-1098-4714-b374-36ff9a75c519 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.922372 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1411/2820] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 16:47:15.926624 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:15.937542 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3129-b8a0-4016-86a7-b9ecc6864489 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:15.942310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:15.943173 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.943491 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.943761 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] PATH_INFO: `/v3/projects/08113cb0fefd4f14815acec05f6d9bfc/users/4a44f1e96b6e4ae1913d5782e20134d1/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.946500 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08113cb0fefd4f14815acec05f6d9bfc, user_id=4a44f1e96b6e4ae1913d5782e20134d1, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:15.949143 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:15.958900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1410/2821] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:15 2022] PUT /identity/v3/projects/08113cb0fefd4f14815acec05f6d9bfc/users/4a44f1e96b6e4ae1913d5782e20134d1/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:15.970077 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:15.970309 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:15.970593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:15.997976 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] MFA Rules not processed for user `4a44f1e96b6e4ae1913d5782e20134d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:15.999180 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:16.066308 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1412/2822] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:16.078463 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:16.080196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:16.157158 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ebc90-2301-4e5c-b129-0dd4cfb26959 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:16.160864 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:16.161499 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:16.161782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:16.162057 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:16.170966 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:16.172418 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:16.181729 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1411/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:16.284725 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:16.286158 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:16.298163 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5290-b04d-4a5a-b833-26653df13b0d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:16.301732 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d2185-0c42-4dd7-a67f-4042bc431a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:16.302374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d2185-0c42-4dd7-a67f-4042bc431a38 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:16.302661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d2185-0c42-4dd7-a67f-4042bc431a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:16.302946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d2185-0c42-4dd7-a67f-4042bc431a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:16.358871 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d2185-0c42-4dd7-a67f-4042bc431a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:16.360334 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d2185-0c42-4dd7-a67f-4042bc431a38 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:16.369647 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1413/2824] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:20.824546 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:20.887018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58666557-fdf8-4623-82f6-67e651617f13 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:20.891730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:20.894561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:20.894561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:20.894561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] PATH_INFO: `/v3/users/2af8a3cba1214848b79211ce94f2178f` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:20.894561 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af8a3cba1214848b79211ce94f2178f)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:20.896268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:21.081495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af8a3cba1214848b79211ce94f2178f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.093508 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af8a3cba1214848b79211ce94f2178f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.094156 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af8a3cba1214848b79211ce94f2178f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.094739 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af8a3cba1214848b79211ce94f2178f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.170798 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af8a3cba1214848b79211ce94f2178f'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.183886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1412/2825] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:20 2022] DELETE /identity/v3/users/2af8a3cba1214848b79211ce94f2178f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:21.188527 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:21.189271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:21.189374 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:21.206205 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:21.207435 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:21.264847 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1414/2826] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:21.274434 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:21.275865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:21.332261 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24672a-546e-4b0c-950b-e44f531e3d6b admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:21.335777 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:21.336408 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:21.336685 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:21.337113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:21.345999 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:21.347469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:21.357404 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1413/2827] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:21.715048 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:21.716571 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:21.729528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2baf0c-f510-4b57-9d10-cae6ed216ed9 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:21.734211 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:21.735068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:21.735385 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:21.735670 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] PATH_INFO: `/v3/projects/e7853ca1d4c34e3f98c4752a262ea22f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:21.736895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7853ca1d4c34e3f98c4752a262ea22f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:21.738801 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:21.851172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7853ca1d4c34e3f98c4752a262ea22f', 'request_id': 'req-e4c70585-5aea-4d7f-8c1b-3631a616ed04'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.857643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7853ca1d4c34e3f98c4752a262ea22f', 'request_id': 'req-e4c70585-5aea-4d7f-8c1b-3631a616ed04'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.863957 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7853ca1d4c34e3f98c4752a262ea22f', 'request_id': 'req-e4c70585-5aea-4d7f-8c1b-3631a616ed04'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.946378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] The token cache is being invalidate because project e7853ca1d4c34e3f98c4752a262ea22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:21.946672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.947329 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:21.948895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1415/2828] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:21 2022] DELETE /identity/v3/projects/e7853ca1d4c34e3f98c4752a262ea22f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:21.952788 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:21.962379 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21e3b4-0f6e-4672-9363-1370cb2ffa1b service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:22.017943 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:22.018829 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:22.019093 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:22.019406 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] PATH_INFO: `/v3/users/4a44f1e96b6e4ae1913d5782e20134d1` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:22.020585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a44f1e96b6e4ae1913d5782e20134d1)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:22.022497 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:22.236076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a44f1e96b6e4ae1913d5782e20134d1'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.248228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a44f1e96b6e4ae1913d5782e20134d1'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.248925 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a44f1e96b6e4ae1913d5782e20134d1'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.249524 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a44f1e96b6e4ae1913d5782e20134d1'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.314270 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-0a602043-ef9d-494b-9c13-03fbd93d24f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a44f1e96b6e4ae1913d5782e20134d1'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.326541 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1414/2829] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:21 2022] DELETE /identity/v3/users/4a44f1e96b6e4ae1913d5782e20134d1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:22.716050 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:22.717593 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:22.730873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c70585-5aea-4d7f-8c1b-3631a616ed04 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:22.786528 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:22.787413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:22.787695 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:22.787968 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] PATH_INFO: `/v3/projects/08113cb0fefd4f14815acec05f6d9bfc` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:22.789125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08113cb0fefd4f14815acec05f6d9bfc)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:22.791113 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:22.875504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08113cb0fefd4f14815acec05f6d9bfc', 'request_id': 'req-f98008a6-ffb5-48fe-b890-449ae7eb0730'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.880989 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08113cb0fefd4f14815acec05f6d9bfc', 'request_id': 'req-f98008a6-ffb5-48fe-b890-449ae7eb0730'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.887615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08113cb0fefd4f14815acec05f6d9bfc', 'request_id': 'req-f98008a6-ffb5-48fe-b890-449ae7eb0730'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.941659 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] The token cache is being invalidate because project 08113cb0fefd4f14815acec05f6d9bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:22.941943 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.942552 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-f98008a6-ffb5-48fe-b890-449ae7eb0730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:22.944175 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1416/2830] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:22 2022] DELETE /identity/v3/projects/08113cb0fefd4f14815acec05f6d9bfc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:22.949787 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:22.950079 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:22.950363 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:22.968337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:22.971489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:23.028782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1415/2831] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:23.036956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.036956 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.037192 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.056987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:23.058228 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:23.066746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1417/2832] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:23.070903 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.081590 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892857e-0e0d-49c7-8e62-2fad99dc77ad None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.086545 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.087239 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.087556 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.087847 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.088568 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:47:23.088866 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.090511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.103018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1416/2833] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:47:23.107296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.116890 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f41e0-f3dd-4543-a126-077b70a86ed5 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.122558 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.123225 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.123560 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.123833 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.124520 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.126392 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.206728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1418/2834] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:23 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 16:47:23.210933 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.220602 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da78ff-6d37-4c28-a747-5e89c9730dc3 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.275073 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.275782 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.276060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.276337 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.277040 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.278929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.360506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1417/2835] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:23 2022] POST /identity/v3/users => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:23.365111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.376378 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8774cd9-1e1b-40ba-b1cc-31faa985162e admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.381213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.381895 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.382183 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.382465 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.383189 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.385467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.395873 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1419/2836] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:23.400766 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.410506 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed3a4f-3dca-431f-a91a-1e00eb8f1cab admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.416326 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ca773-931d-432a-b634-e42663d53555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.416975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca773-931d-432a-b634-e42663d53555 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.417257 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca773-931d-432a-b634-e42663d53555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.417528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca773-931d-432a-b634-e42663d53555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.418236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ca773-931d-432a-b634-e42663d53555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.419831 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ca773-931d-432a-b634-e42663d53555 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.429577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1418/2837] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:23.433530 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.443669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5646-1ffa-4b85-941e-ad10b51e20c4 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.448955 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.449821 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.450104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.450410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] PATH_INFO: `/v3/projects/5f2a1c08205249a88c286d22a934216c/users/c34acf3499bb4c7096c05eeb103838fd/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.465253 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2a1c08205249a88c286d22a934216c, user_id=c34acf3499bb4c7096c05eeb103838fd, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.467920 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.537256 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1420/2838] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:23 2022] PUT /identity/v3/projects/5f2a1c08205249a88c286d22a934216c/users/c34acf3499bb4c7096c05eeb103838fd/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:23.547760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.548076 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.548358 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.575435 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] MFA Rules not processed for user `c34acf3499bb4c7096c05eeb103838fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:23.576680 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:23.639107 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1419/2839] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:23.643531 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.704173 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109fae-1afe-49e5-aec3-239443a2f55a admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.709015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.709672 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.709959 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.710239 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.710936 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.713602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.783170 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1421/2840] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:23 2022] POST /identity/v3/projects => generated 401 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:23.787195 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.798108 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c10d5-09d4-4231-a4e9-ddce0554ba1f None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.853773 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.854425 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.854703 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.854978 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.855674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.857566 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.931469 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1420/2841] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:23 2022] POST /identity/v3/users => generated 307 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:23.935485 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.946637 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d366c-c3b8-4931-9831-e2e443b6fa44 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.951182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.951887 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.952168 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.952441 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:23.953247 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:23.954839 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:23.965967 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1422/2842] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:23.970024 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:23.980790 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229f78-15f3-46db-ba8a-5d8595ff2ef2 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:23.985495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:23.986412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:23.986694 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:23.986970 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] PATH_INFO: `/v3/projects/cf7db2492abb4d82a299863b2910177b/users/4f6fd97dfe9e47bba285316a9d01bc88/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:24.001906 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7db2492abb4d82a299863b2910177b, user_id=4f6fd97dfe9e47bba285316a9d01bc88, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:24.004684 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:24.062145 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1421/2843] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:23 2022] PUT /identity/v3/projects/cf7db2492abb4d82a299863b2910177b/users/4f6fd97dfe9e47bba285316a9d01bc88/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:47:24.066353 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:24.076981 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7a1a-0016-4e17-a482-a473896f84f2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:24.131545 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac34956-93e5-4983-affe-53b5331d09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:24.132208 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac34956-93e5-4983-affe-53b5331d09c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:24.132483 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac34956-93e5-4983-affe-53b5331d09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:24.132757 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac34956-93e5-4983-affe-53b5331d09c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:24.133464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac34956-93e5-4983-affe-53b5331d09c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:24.135410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac34956-93e5-4983-affe-53b5331d09c9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:24.144975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1423/2844] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:24.149082 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:24.161760 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34aab5-fded-4434-8f10-0c03c0b2d8ff admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:24.167095 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:24.167994 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:24.168276 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:24.168551 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] PATH_INFO: `/v3/projects/cf7db2492abb4d82a299863b2910177b/users/4f6fd97dfe9e47bba285316a9d01bc88/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:24.170502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7db2492abb4d82a299863b2910177b, user_id=4f6fd97dfe9e47bba285316a9d01bc88, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:24.173171 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:24.183476 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1422/2845] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:24 2022] PUT /identity/v3/projects/cf7db2492abb4d82a299863b2910177b/users/4f6fd97dfe9e47bba285316a9d01bc88/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:47:24.243018 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:24.243371 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:24.243606 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:24.269664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] MFA Rules not processed for user `4f6fd97dfe9e47bba285316a9d01bc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:24.270949 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:24.338615 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1424/2846] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:24.349150 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:24.350809 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:24.407438 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92799-8eb0-4983-bb30-c913fad88057 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:24.410998 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:24.411663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:24.411944 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:24.412217 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:24.421299 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:24.422716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:24.432047 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1423/2847] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:24.649283 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:24.658714 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb758cc-43d6-4b43-a0a2-6678fbf7e5db None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:24.662215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d6db4-4c4e-4315-801f-9873d42813bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:24.662840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d6db4-4c4e-4315-801f-9873d42813bc service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:24.663122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d6db4-4c4e-4315-801f-9873d42813bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:24.663464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d6db4-4c4e-4315-801f-9873d42813bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:24.717844 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d6db4-4c4e-4315-801f-9873d42813bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:24.719182 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d6db4-4c4e-4315-801f-9873d42813bc service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:24.728171 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1425/2848] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:29.596567 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:29.656985 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0f499-a5a0-45b5-8748-c1799bb47e57 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:29.661717 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:29.662582 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:29.662865 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:29.663140 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] PATH_INFO: `/v3/users/c34acf3499bb4c7096c05eeb103838fd` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:29.664364 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34acf3499bb4c7096c05eeb103838fd)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:29.666702 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:29.881045 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34acf3499bb4c7096c05eeb103838fd'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:29.892859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34acf3499bb4c7096c05eeb103838fd'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:29.893510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34acf3499bb4c7096c05eeb103838fd'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:29.894131 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34acf3499bb4c7096c05eeb103838fd'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:29.987770 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34acf3499bb4c7096c05eeb103838fd'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:30.000877 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1424/2849] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:29 2022] DELETE /identity/v3/users/c34acf3499bb4c7096c05eeb103838fd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:30.005464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:30.005962 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:30.006073 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:30.025346 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:30.026562 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:30.083240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1426/2850] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:30.092982 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:30.094310 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:30.151103 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739ec2-e274-4c94-a25b-87eed0b5eb25 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:30.154709 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:30.155368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:30.155655 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:30.155923 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:30.165374 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:30.166825 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:30.176268 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1425/2851] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:30.583820 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:30.585446 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:30.597840 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b88d56-36bc-448d-bf7f-91baae6015e3 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:30.603144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:30.604142 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:30.604426 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:30.604705 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] PATH_INFO: `/v3/projects/5f2a1c08205249a88c286d22a934216c` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:30.605903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2a1c08205249a88c286d22a934216c)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:30.607865 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:30.702169 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2a1c08205249a88c286d22a934216c', 'request_id': 'req-2e162de8-7536-48f9-9a7e-3a67fc8f821d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:30.707390 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2a1c08205249a88c286d22a934216c', 'request_id': 'req-2e162de8-7536-48f9-9a7e-3a67fc8f821d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:30.713996 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2a1c08205249a88c286d22a934216c', 'request_id': 'req-2e162de8-7536-48f9-9a7e-3a67fc8f821d'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:30.769176 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] The token cache is being invalidate because project 5f2a1c08205249a88c286d22a934216c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:30.769458 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:30.770064 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:30.771691 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1427/2852] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:30 2022] DELETE /identity/v3/projects/5f2a1c08205249a88c286d22a934216c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:30.776243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:30.785939 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5024a-0f61-4c12-980f-60e269963149 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:30.841804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:30.842668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:30.842951 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:30.843229 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] PATH_INFO: `/v3/users/4f6fd97dfe9e47bba285316a9d01bc88` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:30.844426 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6fd97dfe9e47bba285316a9d01bc88)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:30.846333 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:30.995547 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6fd97dfe9e47bba285316a9d01bc88'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.006661 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6fd97dfe9e47bba285316a9d01bc88'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.007365 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6fd97dfe9e47bba285316a9d01bc88'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.007964 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6fd97dfe9e47bba285316a9d01bc88'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.079669 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-d88db170-30bf-40e4-a6ae-1d1aafa3a7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6fd97dfe9e47bba285316a9d01bc88'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.092992 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1426/2853] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:30 2022] DELETE /identity/v3/users/4f6fd97dfe9e47bba285316a9d01bc88 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:47:31.475282 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:31.476762 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:31.492036 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162de8-7536-48f9-9a7e-3a67fc8f821d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:31.552894 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:31.553699 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:31.554011 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:31.554295 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] PATH_INFO: `/v3/projects/cf7db2492abb4d82a299863b2910177b` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:31.556115 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7db2492abb4d82a299863b2910177b)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:31.558035 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:31.696145 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7db2492abb4d82a299863b2910177b', 'request_id': 'req-e1952414-ba3a-4371-bac7-52898c154240'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.701499 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7db2492abb4d82a299863b2910177b', 'request_id': 'req-e1952414-ba3a-4371-bac7-52898c154240'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.707595 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7db2492abb4d82a299863b2910177b', 'request_id': 'req-e1952414-ba3a-4371-bac7-52898c154240'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.803792 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] The token cache is being invalidate because project cf7db2492abb4d82a299863b2910177b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:31.804021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.804652 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e1952414-ba3a-4371-bac7-52898c154240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:31.806884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1428/2854] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:31 2022] DELETE /identity/v3/projects/cf7db2492abb4d82a299863b2910177b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:31.811797 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:31.812320 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:31.812431 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:31.830495 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:31.831845 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:31.889236 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1427/2855] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:31.897062 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:31.897356 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:31.897636 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:31.916190 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:31.917387 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:31.925144 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1429/2856] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:31.929201 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:31.938886 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddc00e-0a77-4870-bb0c-56c669c02d36 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:31.943471 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:31.944112 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:31.944397 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:31.944674 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:31.945389 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:47:31.946211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:31.947816 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:31.959121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1428/2857] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 16:47:31.964034 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:31.973271 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b50709-aa36-4330-92b4-e5e1a60f13af None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:31.978251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:31.978889 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:31.979191 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:31.979487 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:31.980213 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:31.982103 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.091999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1430/2858] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:31 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:32.095983 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.105744 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f8569-248e-44fb-984d-34684bd57b13 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.159453 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.160102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.160380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.160650 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.161317 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.163212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.250620 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1429/2859] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:32 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:32.254692 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.265681 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bd86-77a2-40c3-b861-430733f75e57 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.270442 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.271097 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.271424 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.271708 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.272451 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.274052 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.284432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1431/2860] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:32.288269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.298208 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686c752-a395-47b3-87b6-83fefc5069ed admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.302911 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4c21f-a491-4c53-a136-b5c5577ebbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.303577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c21f-a491-4c53-a136-b5c5577ebbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.303860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c21f-a491-4c53-a136-b5c5577ebbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.304137 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4c21f-a491-4c53-a136-b5c5577ebbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.304853 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c21f-a491-4c53-a136-b5c5577ebbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.306930 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4c21f-a491-4c53-a136-b5c5577ebbc4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.317163 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1430/2861] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:32.322129 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.331999 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767578-e56b-48ad-8751-3ff6424d8bf1 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.336534 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.337578 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.337857 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.338131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] PATH_INFO: `/v3/projects/223ef0519fd74e56a9efef0ddbd8d517/users/35806f2b92b242eebe9550f1e77e0cbf/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.352234 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223ef0519fd74e56a9efef0ddbd8d517, user_id=35806f2b92b242eebe9550f1e77e0cbf, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.354851 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.450781 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1432/2862] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:32 2022] PUT /identity/v3/projects/223ef0519fd74e56a9efef0ddbd8d517/users/35806f2b92b242eebe9550f1e77e0cbf/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:47:32.462046 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.466870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.466870 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.488625 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] MFA Rules not processed for user `35806f2b92b242eebe9550f1e77e0cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:32.489805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:32.553316 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1431/2863] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:32.558434 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.617150 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2352b3-6332-4227-bb92-66d0b9334f95 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.622302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.622950 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.623302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.623581 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.624254 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.626131 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.714661 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1433/2864] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:32 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:32.718651 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.729640 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457f29f-713d-4d38-a46e-22057fade15c None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.782883 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.783629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.783921 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.784196 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] PATH_INFO: `/v3/users` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.784882 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.786821 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.862092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1432/2865] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:32 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:32.865978 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.876503 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20229-30c6-4372-b4c6-80f7db318c8d admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.881046 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.881728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.882015 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.882294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.883014 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.884721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:32.895125 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1434/2866] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:32.899716 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:32.909600 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc54df0-2662-46ee-932c-f8b970510bea admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:32.914255 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:32.915823 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:32.916109 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:32.916387 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] PATH_INFO: `/v3/projects/da40f082fd35488784a7f0aca3a767a5/users/2b88ff17f5594b22adba408dee9e8b0f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:32.931132 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da40f082fd35488784a7f0aca3a767a5, user_id=2b88ff17f5594b22adba408dee9e8b0f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:32.933842 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:33.046188 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1433/2867] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:32 2022] PUT /identity/v3/projects/da40f082fd35488784a7f0aca3a767a5/users/2b88ff17f5594b22adba408dee9e8b0f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:33.050070 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:33.060104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6ff7-a89c-4a85-9af9-2478656309e2 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:33.115453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4deda-c193-4edd-b079-deda016a1501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:33.116114 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4deda-c193-4edd-b079-deda016a1501 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:33.116394 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4deda-c193-4edd-b079-deda016a1501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:33.116669 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4deda-c193-4edd-b079-deda016a1501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:33.117382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4deda-c193-4edd-b079-deda016a1501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:33.118970 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4deda-c193-4edd-b079-deda016a1501 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:33.128564 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1435/2868] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:33.132795 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:33.143818 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b3c21-458b-4976-8bb1-0098d3007872 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:33.148502 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:33.150410 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:33.150692 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:33.150968 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] PATH_INFO: `/v3/projects/da40f082fd35488784a7f0aca3a767a5/users/2b88ff17f5594b22adba408dee9e8b0f/roles/36b9f0766a244c95b8c245ea734587b4` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:33.153102 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da40f082fd35488784a7f0aca3a767a5, user_id=2b88ff17f5594b22adba408dee9e8b0f, role_id=36b9f0766a244c95b8c245ea734587b4)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:33.155772 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:33.166747 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1434/2869] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:33 2022] PUT /identity/v3/projects/da40f082fd35488784a7f0aca3a767a5/users/2b88ff17f5594b22adba408dee9e8b0f/roles/36b9f0766a244c95b8c245ea734587b4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:33.176706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:33.177002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:33.177284 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:33.203512 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] MFA Rules not processed for user `2b88ff17f5594b22adba408dee9e8b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:33.204707 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:33.271071 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1436/2870] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:33.282334 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:33.284064 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:33.340595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b172b3-e555-4a96-9cf6-9dd99c7907bc admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:33.344277 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341455f1-d965-4cde-9213-908f6e4c0f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:33.344909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341455f1-d965-4cde-9213-908f6e4c0f7d service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:33.345194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341455f1-d965-4cde-9213-908f6e4c0f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:33.345470 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341455f1-d965-4cde-9213-908f6e4c0f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:33.398645 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341455f1-d965-4cde-9213-908f6e4c0f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:33.400646 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341455f1-d965-4cde-9213-908f6e4c0f7d service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:33.409232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1435/2871] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:36.363288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:36.424231 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773949-81f6-4440-9110-b5baa93398ab None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:36.428903 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:36.429787 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:36.430880 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:36.431001 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] PATH_INFO: `/v3/users/35806f2b92b242eebe9550f1e77e0cbf` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:36.432172 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35806f2b92b242eebe9550f1e77e0cbf)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:36.434984 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:36.583768 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35806f2b92b242eebe9550f1e77e0cbf'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:36.591177 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35806f2b92b242eebe9550f1e77e0cbf'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:36.591901 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35806f2b92b242eebe9550f1e77e0cbf'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:36.592504 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35806f2b92b242eebe9550f1e77e0cbf'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:36.606884 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35806f2b92b242eebe9550f1e77e0cbf'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:36.695864 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1437/2872] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:36 2022] DELETE /identity/v3/users/35806f2b92b242eebe9550f1e77e0cbf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:36.700634 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:36.701191 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:36.701322 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:36.718462 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:36.719688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:36.777539 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1436/2873] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:36.786969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:36.788382 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:36.845221 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140dd9-bd55-465b-9704-eea695d0f046 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:36.848773 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:36.849408 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:36.849688 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:36.849960 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:36.859322 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:36.860663 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:36.869803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1438/2874] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:37.292174 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:37.304585 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:37.307701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2aad3-73fc-4c7f-b0b0-642716e32b30 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:37.313121 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:37.314232 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:37.314510 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:37.314783 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] PATH_INFO: `/v3/projects/223ef0519fd74e56a9efef0ddbd8d517` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:37.315980 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223ef0519fd74e56a9efef0ddbd8d517)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:37.317922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:37.457758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223ef0519fd74e56a9efef0ddbd8d517', 'request_id': 'req-8c4b8d07-fc45-43fd-b192-097fbb8352d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.541688 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223ef0519fd74e56a9efef0ddbd8d517', 'request_id': 'req-8c4b8d07-fc45-43fd-b192-097fbb8352d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.547437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223ef0519fd74e56a9efef0ddbd8d517', 'request_id': 'req-8c4b8d07-fc45-43fd-b192-097fbb8352d8'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.558311 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] The token cache is being invalidate because project 223ef0519fd74e56a9efef0ddbd8d517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:37.558595 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.559215 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.560771 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1437/2875] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:37 2022] DELETE /identity/v3/projects/223ef0519fd74e56a9efef0ddbd8d517 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:37.564995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:37.574797 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6e2f-2ae1-415d-91e4-f73a7aaa102f service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:37.628696 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:37.629551 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:37.629838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:37.630111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] PATH_INFO: `/v3/users/2b88ff17f5594b22adba408dee9e8b0f` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:37.631409 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b88ff17f5594b22adba408dee9e8b0f)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:37.633975 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:37.807122 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b88ff17f5594b22adba408dee9e8b0f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.814296 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b88ff17f5594b22adba408dee9e8b0f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.814961 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b88ff17f5594b22adba408dee9e8b0f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.815643 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b88ff17f5594b22adba408dee9e8b0f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.827104 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-2aa0a00f-298a-480b-b174-91333878d963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b88ff17f5594b22adba408dee9e8b0f'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:37.901582 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1439/2876] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:47:37 2022] DELETE /identity/v3/users/2b88ff17f5594b22adba408dee9e8b0f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:38.280569 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:38.282028 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:38.295995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b8d07-fc45-43fd-b192-097fbb8352d8 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:38.350074 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:38.350852 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.351129 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.351437 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] PATH_INFO: `/v3/projects/da40f082fd35488784a7f0aca3a767a5` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.353273 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da40f082fd35488784a7f0aca3a767a5)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:38.355178 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:38.442764 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da40f082fd35488784a7f0aca3a767a5', 'request_id': 'req-650337ee-8dab-46a3-b3cc-d26349879495'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:38.501972 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da40f082fd35488784a7f0aca3a767a5', 'request_id': 'req-650337ee-8dab-46a3-b3cc-d26349879495'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:38.507846 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da40f082fd35488784a7f0aca3a767a5', 'request_id': 'req-650337ee-8dab-46a3-b3cc-d26349879495'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:38.519586 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] The token cache is being invalidate because project da40f082fd35488784a7f0aca3a767a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:47:38.519871 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:38.520511 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-650337ee-8dab-46a3-b3cc-d26349879495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:47:38.522052 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1438/2877] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:47:38 2022] DELETE /identity/v3/projects/da40f082fd35488784a7f0aca3a767a5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:38.527899 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.528320 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.528602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.546618 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:38.547838 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:38.608872 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1440/2878] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:38.615402 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.615698 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.615976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.634382 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:38.635576 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:38.643301 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1439/2879] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:38.647467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:38.657167 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382f6a-85cc-4811-bd49-8ef1b1496e96 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:38.661815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:38.662467 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.662772 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.663053 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.663819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:47:38.664728 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:38.666506 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:38.678141 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1441/2880] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:47:38.682670 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:38.691810 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531f40-375b-4bd1-b07b-54dd08eb743a None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:38.696393 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:38.697020 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.697300 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.697570 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.698283 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:38.700204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:38.807269 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1440/2881] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:47:38 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:38.811419 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:38.821868 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fa797-b571-4869-ad56-d80f1d1c1d3b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:38.876200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:38.876793 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.877080 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.877361 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.878042 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:38.880004 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:38.952813 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1442/2882] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:47:38 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:47:38.956975 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:38.967737 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91411267-8a81-411b-b255-7e1b86bba77f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:38.972297 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:38.972942 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:38.973220 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:38.973489 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:38.974200 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:38.975805 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:38.986472 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1441/2883] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:38.990492 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:39.000905 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45d095-bb69-42ec-b0a9-b07621518a1b admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:39.005602 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b49a53-0558-4872-989c-dbe8f57c10a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:39.006259 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49a53-0558-4872-989c-dbe8f57c10a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:39.006649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49a53-0558-4872-989c-dbe8f57c10a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:39.006931 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b49a53-0558-4872-989c-dbe8f57c10a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:39.007697 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49a53-0558-4872-989c-dbe8f57c10a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:39.009746 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b49a53-0558-4872-989c-dbe8f57c10a9 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:39.019664 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1443/2884] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:47:39.024493 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:39.034321 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb93b8-64c1-4266-adca-4b508bc0f816 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:39.038913 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:39.040479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:39.040786 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:39.041029 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] PATH_INFO: `/v3/projects/8eff576741124193b3af9890d92b6795/users/22070ac414d24935bcfbe783037f5171/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:39.054938 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eff576741124193b3af9890d92b6795, user_id=22070ac414d24935bcfbe783037f5171, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:39.057577 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:39.119381 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1442/2885] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:47:39 2022] PUT /identity/v3/projects/8eff576741124193b3af9890d92b6795/users/22070ac414d24935bcfbe783037f5171/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:47:39.124421 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9819-9c3d-4d63-9a30-aec78df3e8df None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:39.124739 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9819-9c3d-4d63-9a30-aec78df3e8df None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:39.125021 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda9819-9c3d-4d63-9a30-aec78df3e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:39.149025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-0dda9819-9c3d-4d63-9a30-aec78df3e8df None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:39.149025 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-0dda9819-9c3d-4d63-9a30-aec78df3e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:39.203795 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1444/2886] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:39.214004 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:39.215756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:39.270147 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfcfab-7b05-47ce-b6f9-e3e6b9ba578f admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:39.274423 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:39.275055 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:39.275368 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:39.275641 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:39.284451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:39.285869 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:39.295304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1443/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:40.435749 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778955fb-b817-4307-9b0b-c0d687dcd9e2 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:40.436280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778955fb-b817-4307-9b0b-c0d687dcd9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:40.436280 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778955fb-b817-4307-9b0b-c0d687dcd9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:40.464633 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-778955fb-b817-4307-9b0b-c0d687dcd9e2 None None] MFA Rules not processed for user `22070ac414d24935bcfbe783037f5171`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:40.465848 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-778955fb-b817-4307-9b0b-c0d687dcd9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:40.535721 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1445/2888] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:40.546802 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:40.548253 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:40.606044 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71698-9a43-44f7-aa11-783495fb5bdd service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:40.609663 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:40.610302 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:40.610584 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:40.610859 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:40.619157 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:40.621248 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:40.630062 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1444/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:47:42.391076 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:42.391627 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:42.391740 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:42.410017 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] MFA Rules not processed for user `22070ac414d24935bcfbe783037f5171`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:47:42.411206 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:42.418488 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1446/2890] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:47:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:47:42.648175 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:47:42.657730 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efb207-f3d9-40f8-a067-0fbe36d25728 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:47:42.661383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:47:42.662012 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:47:42.662295 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:47:42.662571 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:47:42.664340 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:47:42.673775 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:47:42.675204 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:47:42.684063 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1445/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:47:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:48:15.340033 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:48:15.349891 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abcf90-9379-4a37-aac8-57bac8ba073f None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:48:15.353474 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:48:15.354111 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:48:15.354398 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:48:15.354680 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:48:15.356476 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:48:15.425621 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:48:15.427294 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb68298-16e1-45ac-9f79-766ebffb5190 service cinder] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:48:15.438384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1447/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:48:43.541618 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:48:43.550931 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e44a9-a943-4413-8cdc-bc870163dd67 service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:48:43.554529 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:48:43.555165 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:48:43.555480 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:48:43.555758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:48:43.557528 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:48:43.571339 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:48:43.572756 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:48:43.583564 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1446/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:48:58.913490 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:48:58.914023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:48:58.914023 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:48:58.931085 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] MFA Rules not processed for user `22070ac414d24935bcfbe783037f5171`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:48:58.937796 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:48:58.939417 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1448/2894] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:49:34.227411 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:49:34.228804 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:49:34.240533 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83416-5f62-4aa9-8e12-1876b52026d6 service cinder] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:49:34.244092 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:49:34.244718 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:49:34.244995 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:49:34.245380 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:49:34.247110 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:49:34.258271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:49:34.259753 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:49:34.268166 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1447/2895] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:50:09.386782 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:09.398965 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4cce-21bf-4d14-8639-b836d6226658 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:09.403683 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:09.404553 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:09.404856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:09.405184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] PATH_INFO: `/v3/users/22070ac414d24935bcfbe783037f5171` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:09.406260 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22070ac414d24935bcfbe783037f5171)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:09.408240 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:09.573377 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22070ac414d24935bcfbe783037f5171'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:09.580068 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22070ac414d24935bcfbe783037f5171'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:09.580803 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22070ac414d24935bcfbe783037f5171'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:09.581453 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22070ac414d24935bcfbe783037f5171'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:09.593645 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-fe958c3a-e16a-4d98-9d1c-10a1862f1f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22070ac414d24935bcfbe783037f5171'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:09.673832 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1449/2896] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:50:09 2022] DELETE /identity/v3/users/22070ac414d24935bcfbe783037f5171 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:50:09.907066 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:09.919562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df477-2708-463a-96ae-d0e265088d2b service neutron] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:09.976060 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:09.976922 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:09.977198 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:09.977465 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] PATH_INFO: `/v3/projects/8eff576741124193b3af9890d92b6795` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:09.978638 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eff576741124193b3af9890d92b6795)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:09.980562 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.136086 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eff576741124193b3af9890d92b6795', 'request_id': 'req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:10.220271 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eff576741124193b3af9890d92b6795', 'request_id': 'req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:10.226243 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eff576741124193b3af9890d92b6795', 'request_id': 'req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:10.236929 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] The token cache is being invalidate because project 8eff576741124193b3af9890d92b6795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:50:10.237211 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:10.237860 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-cbfcf74a-6dc6-4f4b-9738-66f9db4c887e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:10.239407 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1448/2897] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:50:09 2022] DELETE /identity/v3/projects/8eff576741124193b3af9890d92b6795 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 16:50:10.244384 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.244706 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.244987 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.274623 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:50:10.275859 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:10.332251 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1450/2898] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:50:10.340613 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.340909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.341194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.360016 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:50:10.361193 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:10.369018 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1449/2899] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:50:10.372998 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:10.382448 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834209ee-4ce2-4ccf-9375-ad4c081da288 None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:10.386995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:10.387679 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.387958 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.388232 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.388946 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 16:50:10.389249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:10.390815 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.402769 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1451/2900] 10.222.0.42 () {58 vars in 1152 bytes} [Tue May 3 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 16:50:10.406909 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:10.416689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a266-bbee-497f-84f1-938ebae5fde0 None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:10.421263 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:10.421900 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.422180 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.422451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.423124 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:10.425030 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.561940 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1450/2901] 10.222.0.42 () {60 vars in 1152 bytes} [Tue May 3 16:50:10 2022] POST /identity/v3/projects => generated 397 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:50:10.565856 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:10.576288 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8be95-72a6-4f19-8573-482a9d3558ee admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:10.630735 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:10.631432 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.632236 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.632509 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] PATH_INFO: `/v3/users` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.633184 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:10.635059 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.719028 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1452/2902] 10.222.0.42 () {60 vars in 1143 bytes} [Tue May 3 16:50:10 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 16:50:10.723035 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:10.733412 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30dc3a-d108-40e9-b4ab-de85e6a12766 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:10.738006 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:10.738653 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.738934 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.739207 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.739955 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:10.741657 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.751701 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1451/2903] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:50:10.755576 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:10.766094 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19322c-d600-448b-ab74-51679ba11fac admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:10.770614 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87648-ff6f-4e23-bb30-5c9f7e52d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:10.771277 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87648-ff6f-4e23-bb30-5c9f7e52d3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.771575 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87648-ff6f-4e23-bb30-5c9f7e52d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.771855 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87648-ff6f-4e23-bb30-5c9f7e52d3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.773246 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87648-ff6f-4e23-bb30-5c9f7e52d3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:10.774867 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87648-ff6f-4e23-bb30-5c9f7e52d3f0 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.784502 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1453/2904] 10.222.0.42 () {58 vars in 1121 bytes} [Tue May 3 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 16:50:10.788630 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:10.798451 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02175c5d-d717-4c95-9cc0-d777432809a4 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:10.803058 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:10.804194 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.804479 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.804757 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] PATH_INFO: `/v3/projects/fb3be65815344ef38d86e35eec173598/users/5cac13f953b04fdc95212f692e4b9cf9/roles/a39aa06b3d53485e8b99f7660fba1306` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.819530 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3be65815344ef38d86e35eec173598, user_id=5cac13f953b04fdc95212f692e4b9cf9, role_id=a39aa06b3d53485e8b99f7660fba1306)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:10.822212 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:10.886203 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1452/2905] 10.222.0.42 () {60 vars in 1482 bytes} [Tue May 3 16:50:10 2022] PUT /identity/v3/projects/fb3be65815344ef38d86e35eec173598/users/5cac13f953b04fdc95212f692e4b9cf9/roles/a39aa06b3d53485e8b99f7660fba1306 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:50:10.896689 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] REQUEST_METHOD: `POST` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:10.896995 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:10.898024 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:10.923940 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.auth.core [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] MFA Rules not processed for user `5cac13f953b04fdc95212f692e4b9cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:50:10.925149 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:10.987810 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1454/2906] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:50:10.999629 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:11.001304 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:11.057172 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12814bb-691b-460f-83ec-a8553da19142 admin admin] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:11.060778 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0166-6523-44fb-abe1-7aecb6c39798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d24cf5fddb64b1096184a842975ae3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:11.061409 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0166-6523-44fb-abe1-7aecb6c39798 service cinder] REQUEST_METHOD: `GET` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:11.061689 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0166-6523-44fb-abe1-7aecb6c39798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:11.061961 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0166-6523-44fb-abe1-7aecb6c39798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:11.070711 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0166-6523-44fb-abe1-7aecb6c39798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:11.072168 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0166-6523-44fb-abe1-7aecb6c39798 service cinder] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:11.080668 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1453/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:50:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 16:50:19.946130 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:20.030060 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ad72-f541-41a1-997d-a98d08a2636d None None] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:20.034750 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:20.035649 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:20.035937 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:20.036215 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] PATH_INFO: `/v3/users/5cac13f953b04fdc95212f692e4b9cf9` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:20.037413 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cac13f953b04fdc95212f692e4b9cf9)` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:20.039369 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:20.215336 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cac13f953b04fdc95212f692e4b9cf9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:20.221928 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cac13f953b04fdc95212f692e4b9cf9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:20.222591 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cac13f953b04fdc95212f692e4b9cf9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:20.223200 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cac13f953b04fdc95212f692e4b9cf9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:20.234500 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.notifications [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cac13f953b04fdc95212f692e4b9cf9'} {{(pid=80030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:20.322302 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1455/2908] 10.222.0.42 () {58 vars in 1223 bytes} [Tue May 3 16:50:19 2022] DELETE /identity/v3/users/5cac13f953b04fdc95212f692e4b9cf9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:50:20.326758 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] REQUEST_METHOD: `POST` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:20.328031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:20.328031 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:20.344350 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.auth.core [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] MFA Rules not processed for user `bb40ca9c41484170a3eb1edcceb6c0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 16:50:20.345534 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:20.404065 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1454/2909] 10.222.0.42 () {58 vars in 957 bytes} [Tue May 3 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 16:50:20.413622 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:20.415013 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:20.486410 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eabcb2-dcde-4ba7-bca9-8e0020e2cc67 admin admin] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:20.489906 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79eb9c30fbae438784968a8f770a92f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:20.490538 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:20.490819 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:20.491090 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:20.501002 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:20.502464 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:20.512293 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1456/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 16:50:20.913054 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] Authenticating user token {{(pid=80029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:50:20.914454 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.fernet_utils [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:50:20.926824 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61fc2-2676-434d-95cc-68c5fd779daa None None] Validating token access rules against request {{(pid=80029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:50:20.931984 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb40ca9c41484170a3eb1edcceb6c0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edec15e0ee20483fb7e945e977a36993', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:50:20.932839 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:50:20.933113 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:50:20.933383 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] PATH_INFO: `/v3/projects/fb3be65815344ef38d86e35eec173598` {{(pid=80029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:50:20.934553 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3be65815344ef38d86e35eec173598)` {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:50:20.936505 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] RBAC: Authorization granted {{(pid=80029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:50:21.047976 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3be65815344ef38d86e35eec173598', 'request_id': 'req-95531b27-5712-459b-8b57-ca5b6e6da21a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:21.099439 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3be65815344ef38d86e35eec173598', 'request_id': 'req-95531b27-5712-459b-8b57-ca5b6e6da21a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:21.105386 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3be65815344ef38d86e35eec173598', 'request_id': 'req-95531b27-5712-459b-8b57-ca5b6e6da21a'} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:21.116228 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] The token cache is being invalidate because project fb3be65815344ef38d86e35eec173598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80029) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 16:50:21.116516 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:21.117142 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: DEBUG keystone.notifications [None req-95531b27-5712-459b-8b57-ca5b6e6da21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80029) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 16:50:21.118779 dv-cinder-840324-1-iscsi devstack@keystone.service[80029]: [pid: 80029|app: 0|req: 1455/2911] 10.222.0.42 () {58 vars in 1232 bytes} [Tue May 3 16:50:20 2022] DELETE /identity/v3/projects/fb3be65815344ef38d86e35eec173598 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 16:51:25.069223 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] Authenticating user token {{(pid=80030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 16:51:25.070629 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:51:25.159198 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac294c72-f71f-41b7-9757-ed8f3babaa81 service neutron] Validating token access rules against request {{(pid=80030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 16:51:25.218079 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16fc7e5d900a487d83be32cd8c2ffbfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6c055ef88fb4f6485c8fe60c312adbd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 16:51:25.218743 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] REQUEST_METHOD: `GET` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 16:51:25.219126 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 16:51:25.219438 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 16:51:25.221248 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.fernet_utils [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 16:51:25.232249 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 16:51:25.233969 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444126e-f9b4-493a-b3f1-efa38a1f80d9 service placement] RBAC: Authorization granted {{(pid=80030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 16:51:25.243831 dv-cinder-840324-1-iscsi devstack@keystone.service[80030]: [pid: 80030|app: 0|req: 1457/2912] 10.222.0.42 () {60 vars in 1365 bytes} [Tue May 3 16:51:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)